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BACKGROUND OF THE INVENTION 

T hp pmprjTPnrp nf tk ^ Tn l H i'li e r- nnd nihor Inrgo nft t ia/nrlrg h ag inc r eased hothA ^ 

number and kinds of electronic exchanges between entities. As used hereirua^Hectronic 
exchange is any exchange between two or more entities over an elecjperfuc network (i.e., 
not in person) such as, for example, a voice commimications^adwork (e.g., POTS or 
PBX) or a data communications network (e.g., LAN jjjKrie Internet) or a voice-and-data 
communications network (e.g., voice-over-IP^petwork). Electronic exchanges may 
include electronic business transactior^alia electronic communications. Such electronic 
business transactions may incluck'fne negotiation and closing of a sale of goods or 
services, including solicitation of customers, making an offer and accepting an offer. For 
example, in consurp^f-to-consumer electronic marketplaces (e.g., the eBay, OnSale, 
Yahoo and Aitfiazon marketplaces found on the global Internet at the following 
respe^ti^e URLs: www.ebay.com , www. onsale. com , www.yahoo.com , and 
w^^amazon xom^ ent itie s - may transact for the sa l e and purchase of rc oodi or s ervi ces v 

Electronic communications also may include communications in on-line 
communities such as mailing lists, news groups, or web-based message boards and chat 
rooms, where a variety of sensitive personal information may be exchanged, including 
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health-related data, financial investment data, help and advise on research and 
technology-related issues, or even information about political issues. As referred to 
herein, an entity may be a person or an electronic agent (e.g., a software agent). Such a 
person may Act as an individual (i.e., on the person's own behalf) or as a representative 

5 (e.g., officer or agent) of a corporation, partnership, agency, organization, or other group. 
An electronic agent may act as an agent of an individual, corporation, partnership, 
agency, organization, or other group. 

In many electronic exchanges, an entity's identity may be anonymous to another 
entity. This anonymity raises several issues regarding trust and deception in connection 

10 to these exchanges. For example, an anonymous entity selling goods on-line may 
misrepresent the condition or worth of a good to a buyer without suffering a loss of 
reputation, business or other adverse effect, due to the entity's anonymity. 

One solution to the problems regarding trust and deception is to provide a 
reputation mechanism to determine and maintain a reputation or reliability rating of an 

15 entity. Typically, a reputation mechanism is intended to provide an indication of how 
reliable an entity is, i.e., how truly its actions correspond to its representations, based on 
feedback by other entities that have conducted an electronic exchange with the entity. 
Such feedback typically is provided by another entity in the form of ratings in a 
numerical (e.g., 1-5) or Boolean (e.g., good or bad) form. In some reputation 

20 mechanisms, an average of the ratings provided by other entities are calculated to 

produce the reputation rating of the entity. Consequently, such reputation mechanisms 
typically represent the reputation of an entity with a scalar value. 

Typical reputation mechanisms suffer from susceptibility to frauds or deceptions. 
For example, a first typical fraud occurs when an anonymous entity, after developing a 

25 poor reputation over time in an on-line community, reenters the community with a new 
anonymous identity (i.e., on-line name), thereby starting anew with a higher reputation 
than the entity's already earned poor reputation. A second typical fraud, to which typical 
reputation mechanisms are susceptible, occurs when two or more entities collude to 
provide high ratings for each other on a relatively frequent basis, such that the 

30 reputations of these entities are thereby artificially inflated. 

Two reputation mechanisms that solve these two problems, Sporas and Histos, 
are disclosed in "Collaborative Reputation Mechanisms for On-line Communities" by 
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Giorgos Zacharia, submitted to the Program of Media Arts and Sciences, Massachusetts 
Institute of Technology, Cambridge, MA published September, 1999 (hereinafter "the 
Zacharia thesis"), the contents of which are herein incorporated by reference. 

Sporas is a reputation mechanism for loosely-connected communities (i.e., one in 
5 which many entities may not have had an electronic exchange with one another and thus 
not have rated one another.) According to the Sporas technique, a reputation may be 
calculated for an entity by applying the following equation: 

Equation 1 : R, = R„ + ^ • damp{R i . x )Rf er (w, - E i \ 

where is the initial reputation of the entity, C is an effective number of 
10 ratings, 1/C is the change rate factor, named as such because it impacts the rate at which 
the reputation changes, damp (R^) is a damping function, R° ther is the reputation of 
another entity providing the rating, W t is the rating of the entity provided by the other 
entity, E t is the expected value of the rating and Ri is the reputation of the entity. 

Zacharia discloses that the damping function may be calculated by applying the 
15 following equation: 

Equation 2 : damp{R^ x ) = 1 D ^ , 

l + e a 

where D is the size of the range of allowed reputation values and a is a so-called 
"acceleration" factor. The acceleration factor is named as such because its value controls 
a rate at which an entity's reputation changes. The Zacharia thesis further discloses that 
20 an expected rating, Ej can be calculated from the following equation: 

Equation 3 : E i , = — 

(Throughout this application, if a value represented by a symbol from a current 
equation was described in connection with a previously-described equation, the 
description of the value will not be repeated for the current equation.) 
25 The Sporas technique implements an entity reputation mechanism based on the 

following principles. First, new entities start with a minimum reputation value, and 
build-up their reputations as a result of their activities on the system. For example, if a 
reputation mechanism has a rating range from 1 to 100, then an entity may start with an 
initial reputation value, Ro, of 1 . By starting with the minimum reputation value, Sporas 
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reduces the incentive to, and effectively eliminates, that ability of an entity with a low 
reputation to improve the entity's reputation by reentering the system as a new 
anonymous identity. 

Second, the reputation of an entity never falls below the reputation of a new 
5 entity. This may be ensured by applying equation 1 above. This second principle also 
reduces the incentive, and effectively prevents, an entity with a low reputation from 
reentering the system as a new anonymous entity. 

Third, after each electronic exchange, the reputations of each of the two or more 
entities involved are updated according to the feedback or ratings provided by the other 
10 entities, where the feedback or ratings represent the demonstrated trustworthiness of the 
two or more entities in the latest exchange. For example, referring to Equation 1 above, 
the ratee reputation Rj of an entity is updated for each new rating, 

Fourth, two entities may rate each other only once. If two entities exchange more 
than once, then, for each entity, the reputation mechanism only applies the most recently 
15 submitted rating to determine the reputation of the rated entity. This fourth principle 
prevents two or more entities from fraudulently inflating their reputations, as describe 
above, by frequently rating each other with artificially high ratings. 

Fifth, entities with very high reputation values experience smaller rating changes 
after each update. This fifth principle is implemented by the damping function, damp(Ri. 
20 j), of Equations 1 and 2 above. The damping function increases as the ratee reputation 
of the rated entity decreases, and decreases as the ratee reputation of the rated entity 
increases. Thus, a high reputation is less susceptible to change by a single poor rating 
provided by another entity. 

Sixth, the reputation mechanism adapts to changes in an entity's behavior. For 
25 example, a reputation may be discounted over time so that the most recent ratings of an 
entity have more weight in determining the ratee reputation of the entity. For example, 
in Equation 1, above, ratings are discounted over time by limiting the effective number 
of ratings considered, C. 

The Sporas reputation mechanism also weights the reputation of a rated entity 
30 according to the reputation, R other ^ of another entity providing the rating, where this 
reputation of the other entity may be determined by applying Equation 1 . Therefore, 
ratings from entities having relatively higher reputations have more of an impact on the 



reputation of the rated entity than ratings from entities having relatively lower 
reputations. 

As described in the Zacharia thesis, Histos is a reputation mechanism better- 
suited for a highly-connected community, where entities have provided ratings for a 
significant number of the other entities. Histos determines a personalized reputation of a 
first entity from a perspective of a particular entity. 

Histos represents the principle that a person or entity is more likely to trust the 
opinion of another person or entity with whom she is familiar than trust the opinion of 
another person or entity who she does not know. Unlike Sporas, a reputation of first 
entity in Histos depends on the second entity from whose perspective the determination 
is made, and other ratings of the second entity provided by other users in an on-line 
community or population. 

Fig. 1 is a block diagram illustrating a representation of an on-line community or 
population 300 of entities Ai-An interconnected by several rating links, including rating 
links 302, 303, 304, 306, 308 and 310. Each rating link indicates a rating of a rated 
entity (i.e., a ratee) by a rating entity (i.e., a rater) with an arrowhead pointing from the 
rating entity to the rated entity. As used herein, a ratee is an entity in a position of being 
rated by one or more other entities, and a rater is an entity in a position of rating one or. 
more other entities. For example, rating link 302 represents a rating of 0.8 for ratee A3 
by rater Ai, and rating link 303 represents a rating of 0.9 for ratee Ai by rater A3. 

Although in Fig. 1, each rating link only indicates a single rating, it is possible 
that an entity has provided more than one rating for another entity. The Zacharia 
reference discloses that if entity has provided more than rating for another entity, the 
most recent rating should be selected to determine a personalized reputation of a first 
entity from the perspective of a second entity. 

To __determine a personalized reputation of a first entity from th^prr^^rt\\^rrf ft 
second entity, the first and second entity must be "connected". Afi£st-allff*second entity 
are connected if a rating path connects the first andsgs^ntferrtity. A rating path is a 
series of rating links that connect a first^irti15rto a second entity. For example, in Fig. 1 , 
entities Ai and An arec^nnetTfea by several rating paths, including rating paths 312 and 
314. Rating^attfSn includes rating links 302, 304 and 312, and rating path 314 
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As described in the Zacharia thesis, and referring to Fig. 1, to determine a 
personalized reputation of a first user from the perspective of a second user, the 
following methodology may be applied. First, a breadth-first search algorithm is applied 
to find all of the rating paths connecting Aj to Ai 1 that are of a length less than or equal 
5 to a specified value. If a rating link indicates more than one rating, then the most recent 
rating is selected for the determination of the personalized reputation. 

The number of rating links included in a rating path is referred to herein as the 
"length" of the rating path. For example, the rating path 312 has a length =3 because it 
includes three rating links 302, 304 and 310. Further, an entity included along a rating 
10 path between the first rated entity and the second rating entity has a "level" equal to a 
number of links between the entity and the second entity. For example, in Fig. 1 , the 
entity Ag is disposed along the rating path 314. The entity Ag has a level 2 in the context 
of the rating path 314 because two rating links 302 and 306 lie between the entity A 8 and 
the second entity Ai. Further, an entity having a level, L, may be said to be a distance L 
1 5 away from the second entity. 

Accordingly, the personalized reputation of a first entity from the perspective of a 
second entity may be determined by application of the following equation: 

Accordingly, the personalized reputation of a first entity from the perspective of a 
second entity may be determined by application of the following equation: 



where Rk(n) is the personalized ratee reputation of an entity k from a perspective 
of a second entity a distance n from the entity k, Wjk(n) is a rating provided by an entity j 
for the entity k a distance n-1 from the second entity, Rj(n-1) is the personalized ratee 
reputation of the entity j from the perspective of the second entity, and D is a range of 
25 allowable personalized reputation values. 

Referring to Fig. 1, the following example illustrates applying Equation 4 to 
determine the personalized ratee reputation of entity Ai i from the perspective of entity 
Ai, where D=l. 



Equation 4 : R k (n) = 



D^[Rj{n-\).W jk {n)] 
^Rjin-l) 



20 



R g (.2) + R 8 (.9) 
R s + R 9 



where R g — 



* 3 (-2) 

*3 



= .2, and 



where R 



8 




such that R u = 



.2(.2) + .6(.9) 
.8 



= .725 . 



SUMMARY OF THE INVENTION 



The Histos reputation mechanism, in determining a reputation of a first entity 
from the perspective of the second entity, does not consider a distance of a shortest 
reputation path, i.e., the lowest number of rating links, between the first and second 
entity. Therefore, the determined reputation does not reflect the distance of the shortest 
reputation path. 

It may be desirable to consider the shortest distance between the first and second 
entities when determining the reputation of the first entity from the perspective of the 
second entity. Considering this distance addresses the principle that the second entity 
may have more trust for a first entity with which the second entity is in relatively closer 
contact than in a first entity with which the second entity is in relatively distant contact . 

Accordingly, provided herein is a method and system for determining a 
personalized ratee reputation of a first entity from a perspective of a second entity, where 
the determined ratee reputation is weighted according to a distance of a shortest 
reputation path between the first and second entities. 

In an embodiment, for a population of entities, a personalized ratee reputation of 
a first entity from the perspective of a second entity is determined. The second entity is 
associated with the first entity by one or more rating paths, where a rating path includes 
one or more rating links. Each rating link defines a rating of a rated entity provided by a 
rating entity, and each rating path has a length defined as a number of rating links 
included in the path. Each entity included on one of the rating paths has a level defined 
as a number of rating links between the entity and the second entity. A breadth-first 
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search is performed, beginning at the second entity, to determine, from the one or more 
rating paths, one or more first rating paths that have a first length equal to a shortest 
length between the first entity and the second entity. For each determined first rating 
path, a third entity on the first rating path that has a level equal to one less than the first 
5 length is identified. For each identified third entity, a first rating of the first entity 
provided by the third entity is determined, and the first ratings are combined. The 
personalized ratee reputation is then produced by weighting the combined first ratings by 
an amount according to the first length. 

This embodiment may be implemented as a computer program product that 

10 includes a computer readable medium and computer readable signals stored on the 
computer readable medium that define instructions. These instructions, as a result of 
being executed by a computer, instruct the computer to perform the acts described above 
for this embodiment. 

In another embodiment, a personalized ratee reputation generator is provided for 

1 5 determining, in a population of entities, a personalized ratee reputation of a first entity 
from the perspective of a second entity. The second entity is associated with the first 
entity by one or more rating paths, where a rating path includes one or more rating links. 
Each rating link defines a rating of a rated entity provided by a rating entity, and each 
rating path has a length defined as a number of rating links included in the path. Each 

20 entity included on one of the rating paths has a level defined as a number of rating links 
between the entity and the second entity. The system includes at least a path-searching 
module, a first look-up module, a second look-up module, and a ratings combining 
module. The path-searching module receives as input an indication of the first entity 
and an indication of the second entity. The path-searching module performs a breadth- 

25 first search beginning at the second entity and determines, from the one or more rating 
paths, one or more first rating paths that have a first length equal to a shortest length 
between the first entity and the second entity. The path-searching module provides as 
output an indication of the one or more first rating paths. The first look-up module 
receives as input the indication of the one or more first rating paths and identifies, for 

30 each determined first rating path, a third entity on the first rating path that has a level 
equal to one less than the first length. The first look-up module provides as output an 
indication of the one or more third entities. The second look-up module receives as input 
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the indication of the first entity and the indication of the one or more third entities, and 
determines, for each third entity, a first rating of the first entity provided by the third 
entity. The second look-up module provides as output the first ratings. The ratings 
combining module receives as input the first ratings, generates the personalized ratee 
5 reputation by combining the first ratings and weighting the combined first ratings by an 
amount according to the first length, and provides as output the personalized ratee 
reputation. 

In yet another embodiment, for a population of entities, a system for determining a 
personalized ratee reputation of a first entity from the perspective of a second entity is 

10 provided. The second entity is associated with the first entity by one or more rating 

paths, where a rating path includes one or more rating links. Each rating link defines a 
rating of a rated entity provided by a rating entity, and each rating path has a length 
defined as a number of rating links included in the path. Each entity included on one of 
the rating paths has a level defined as a number of rating links between the entity and the 

15 second entity. The system includes: means for performing a breadth- first search 

beginning at the second entity to determine, from the one or more rating paths, one or 
more first rating paths that have a first length equal to a shortest length between the first 
entity and the second entity; means for identifying, for each determined first rating path, 
a third entity on the first rating path that has a level equal to one less than the first length; 

20 means for determining, for each identified third entity, a first rating of the first entity 
. provided by the third entity; means for combining the first ratings; and means for 
producing the personalized ratee reputation by weighting the combined first ratings by an 
amount according to the first length. 

The features and advantages of the invention described above and other features 

25 and advantages of the invention will be more readily understood and appreciated from 
the detailed description below, which should be read together with the accompanying , 
drawing figures. 



BRIEF DESCRIPTION OF THE DRAWINGS 
30 In the drawings : 

Fig. 1 is a block diagram illustrating a representation of an on-line community of 
entities interconnected by several rating links; 
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Fig. 2 is a flowchart illustrating an example embodiment of a method of 
determining a rater reputation of an entity; 

Fig. 3 is a flow chart illustrating an example embodiment of a method of 
combining rating predictabilities to produce a rater reputation; 
5 Fig. 4 is data flow diagram illustrating an example embodiment of a system for 

generating a rater reputation of an entity; 

Fig. 5 is a data flow diagram illustrating an example embodiment of a system for 
generating a rater reputation of an entity; 

Fig. 6 is a data flow diagram illustrating an example embodiment of a system for 
10 generating a ratee reputation deviation of an entity; 

Fig. 7 is a data flow diagram illustrating an example embodiment of a system for 
generating a rater reputation deviation of an entity; 

Fig. 8 is a flowchart illustrating an example embodiment of a method of 
generating a ratee reputation of an entity; 
15 Fig. 9 is a data flow diagram illustrating an example embodiment of a system for 

generating a ratee reputation of an entity; 

Fig. 1 0 is a flowchart illustrating an example embodiment of a method of 
determining a personalized ratee reputation; 

Fig. 1 1 is a data flow diagram illustrating an example embodiment of a system 
20 for determining a personalized ratee reputation; 

Fig. 12 is a flow chart illustrating an example embodiment of recursively 
estimating the impact of one or more ratings on a result; 

Fig. 1 3 is a data flow diagram illustrating an example embodiment of a system 
for recursively estimating the impact of one or more ratings on a result; 
25 Fig. 14 is a flowchart illustrating an example embodiment of a method of 

generating a weighting vector for a set of multiple ratings; 

Fig. 1 5 is a data flow diagram illustrating an example embodiment of a system 
for generating a weighting vector for a set of multiple ratings; 

Fig. 16 is a flow chart illustrating an example embodiment of a method of 
30 combining multiple estimated reputations to produce a new reputation; 

Fig. 17 is a data flow diagram illustrating an example embodiment of a system 
for combining multiple estimated reputations to produce a new estimated reputation; and 
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Fig. 1 8 is a data flow diagram illustrating an example system architecture for 
implementing the methods and systems of Figs. 2-17. 

DETAILED DESCRIPTION 
5 I. Determining a Rater Reputation 

Described below is a method and system for determining a rater reputation of a 
first entity. Although determining a rater reputation is described below primarily in 
connection to ratings developed in connection with electronic exchanges, such 
determination may be applied to any of a variety of ratings, regardless of whether the 

10 rating is provided as a result of an electronic exchange. For example, a rating may 
represent a qualitative assessment of an in-person interview of a job candidate, an in- 
person sale or a credit transaction. 

The rater reputation produced using the method and system described below may 
have any of a variety of applications such as, for example, assessing the trustworthiness 

15 (as a rater) of a reference, an employment recruiter, a rating agency, or any other entity 
that provides recommendations, scores, rankings or ratings of other entities. 

A rater reputation may be determined, for one or more ratings of one or more 
rated entities, respectively, provided by a first entity, by comparing each rating to other 
ratings of the rated entity provided by other entities. For each rated entity, the statistical 

20 similarity between the rating provided by the first entity and ratings provided by the 

other entities as determined by the comparison, i.e., the rating predictability, may serve 
as a basis for a rater reputation of the first entity. 

Optionally, the ratings provided by the other entities may be ratings provided at 
points in time that occur after a point in time at which the rating by the first entity is 

25 provided. Determining a rater reputation of a first entity by comparing ratings provided 
by the first entity to such future ratings may provide a more accurate estimate of the first 
entity's rater reputation than comparing these ratings to past ratings of other entities. 
This more accurate estimate may result from the fact that if past ratings are used for the 
comparisons, and the first entity is aware that past ratings are being used, the first entity 

30 may access the past ratings and bias her ratings to be consistent with the past ratings, 
thus resulting in a higher reputation of the first entity than otherwise would occur. 
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Accordingly, by using future ratings, which are necessarily unknown to the first 
user, for the comparisons, the first entity has less incentive to bias her ratings, resulting 
in more honest ratings being provided by the first entity. These more honest ratings 
result in a more accurate estimation of the rater reputation of the first entity. 

5 " f I VflM r l Sj ' ^ rf v 1l n t ' B T fmfri ng F l rater reputation of an entity thf* r p.giilt 

comparison of (a) the rating provided by the first rating of a rated entity23d(b) other 
ratings of the rated entity provided by other raters may be weighgeKSver a ratee 
reputation deviation of the rated entity, as will be descriljpd'm more detail below in 
relation to Fig. 5. This ratee reputation deviation^e^resents a deviation of ratings of the 
0 rated entity from an expected value of thp^ting of the rated entity. Entities whose ratee 
reputations fluctuate over a widg^nge of values, such as new entities and entities that 
receive a wide range of^atmgs (i.e., unstable entities), typically have high ratee 
reputation deyi^fcitJns. This weighting of the comparison results in a rating predictability 
that is greater for greater values of ratee reputation deviation and less for lesser values of 

15 ^agee-feptrtatio n - deviation. 

Fig. 2 is a flowchart illustrating an example embodiment of a method of 
generating a rater reputation of an entity, where a first rating of a rated entity by a first 
entity and second ratings of the rated entity provided by other entities are provided. The 
first and second ratings may be provided by accessing two or more entries of a data 
20 structure such as, for example, a database, stored on a computer-readable medium such 
as, for example, a non-volatile memory (e.g., a magnetic disk, CD ROM, or magnetic 
tape) or a volatile memory (e.g., an integrated semiconductor memory such as RAM). 
Such a data structure may reside on a computer-readable medium located on a same 
computer at which an application running the method of generating resides and may be 
25 accessed by a bus or other known means. Alternatively, the data structure may reside at 
a remote location from such application, where access of the data structure may include 
use of one or more networks, bridges, routers, switches, hubs, other network devices, or 
any combination thereof. Such access may include wireless and wire (i.e., cable) 
transmissions. 

30 In Act 2, two or more of the second ratings of the rated entity may be combined 

to produce an expected rating. This expected rating represents an expected value of the 
first rating in consideration of the values of the two or more second ratings. The two or 
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more ratings to be combined may be selected according to each rating's temporal 
proximity to the rating provided by the first entity (i.e., the first rating), or may be 
selected with other criteria such as, for example, demographic similarity of the entity that 
provided the second rating to the first entity. Optionally, only second ratings provided 
5 temporally after the first rating are selected. Such selected second ratings may be 

referred to herein as future ratings. Although all of the second ratings may be selected, 
which may produce a more accurate expected rating, the computational time and cost 
will increase as the number of second ratings combined increases; consequently, it may 
be desirable to select less than all of the second ratings. 
10 A limiting factor may be provided to determine a number of the second ratings to 

select. The value of the limiting factor may be selected to achieve an acceptable balance 
between (a) rater reputation accuracy and (b) the time and cost of determining the rater 
reputation. 

In an aspect of selecting second ratings, second ratings provided by the first 
15 entity are excluded from selection. Such exclusion prevents the first entity from 
providing multiple ratings of the rated entity, and intentionally providing a same or 
similar value as each of the multiple ratings to artificially increase the first entity's rater 
reputation. 

The selected second ratings may be combined by calculating an average of the 
20 second ratings. Optionally, this calculated average may be weighted, where each 

selected second rating is weighted according to the reputation of the entity that provided 
the second rating relative to the reputation of the other entities that provided second 
ratings. For example, a weighted average of second ratings provided by other entities 
may be determined by applying the following equation: 

25 Equation 5: E™ ee ' olher , 

U=j+] 

where k-j is the number of selected second ratings, £ Jk ratee > other [ s the weighted 
average of the k-j second ratings, W u is the rating provided by a second entity w, and 
Rj ater is the rater reputation of second entity u. Although applying Equation 5 represents 
combining only future rating (from y+7 to k), other second ratings may be combined. 
30 For example, in Equation 5, above, u may begin at u-j-l-C/2 and end at k=j-l+C/2 , 
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where 1/C is a change rate factor, described in more detail below in relation to Act 12. A 
situation in which it may be desirable to determine an expected rating by combining 
selected second ratings other than future ratings is described below in more detail in 
relation to "seeding" a system. 
5 Weighting each second rating according to the reputation of the entity that 

provided the second rating generates an expected rating that gives more weight to ratings 
by those entities that have higher rater reputations. For example, if most of the higher 
second ratings were provided by entities having a low rater reputation, and most of the 
lower second ratings were provided by entities having a higher rater reputation, then the 

10 calculated expected rating would be lower than a raw average. This lower expected 
rating represents a bias towards the second ratings provided by the entities having a 
higher rater reputation. Such weighting of each selected second rating represents the 
principle that entities having higher rater reputations give more accurate ratings, and thus 
the ratings they provide are more valuable in determining a rater reputation of an entity 

15 (by definition) and, therefore, should be given more weight than ratings provided by 
entities having lower rater reputations. 

The average rating of the selected second ratings also may be weighted according 
to the relative proximity of the times at which the selected second ratings are provided to 
the time at which the first rating is provided. In other words, a rating provided closer in 

20 time to the first rating time will have a greater weight and thus more of an impact on the 
calculated average than a temporally more distant rating. This weighting reflects the 
principle that an entity's ratee reputation may change over time. Thus, for a given time 
at which a first rating is compared to other ratings, temporally closer ratings should be 
given more weight in determining the rater reputation of the first entity. Conversely, 

25 temporally more distant ratings should have lesser weight in determining the rater 
reputation of the first entity. 

If only second ratings occurring after the first point in time (i.e., future ratings) 
are selected, then the earlier the second rating is provided, the greater is the weight 
attributed to the second rating. Further, time may be divided into a number of intervals, 

30 where each second ratings is provided during one of the intervals. Each second rating 
may be weighted according to the temporal proximity to the first point in time of the 
interval in which the second rating was provided. 
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Optionally, each selected second rating may be placed in a temporal order 
according to its relative temporal proximity to the first point in time, and each selected 
second rating may be weighted according to its position in this order. If only future 
ratings are selected, then the earlier the second rating is provided, the lower (i.e., the 
closer to the beginning) the rating is in the temporal order. Thus, a temporally-weighted 
average may be defined by the following equation: 

ix/(«) 

Equation 6 : E™ ee -° ,her = ^ , 

w=/+l 

where X") is a temporal function such as, for example: 
Equation 7: f(u) = ~-, 

where Tis a constant number having a value > 1, and u may be: the position of 
rating W u in a temporal order; a temporal proximity of the rating from the first point in 
time; or a temporal proximity of a time interval in which the rating was provided to the 
first point in time. 

Combining Equations 6 and 7, an expected rating may be calculated by applying 
the following equation: 

© . rpratee .others "=7+1 

Equation 8 : h Jk — ^ . 

n- j+i 

Other statistical methods may be used to determine an expected rating of an 

entity. 

Returning to the method of Fig. 2, next, in Act 4, the first rating of the rated 
entity, provided by the first entity, may be compared to the expected rating, to produce a 
rating predictability. This rating predictability may be a negative function of an absolute 
difference between the first rating and the expected rating. As used herein, a first value 
is a negative function of a second value if the first value decreases as a result of the 
second value increasing, and increases as a result of the second value decreasing. 
Further, as used herein, a first value is a positive function of a second value if the first 
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value increases as a result of the second value increasing, and decreases as a result of the 
second value decreasing. 

For example, comparing the first ratings and the second ratings may include 
determining the absolute difference (i.e., magnitude of the difference) between the first 
5 rating and the second rating and then applying a Gaussian distribution function to the 
determined absolute difference to produce the first rating predictability. If a Gaussian 
distribution function is being applied, then the absolute difference between the first 
rating and the expected rating may first be divided by a ratee reputation deviation of the 
rated entity. The ratee reputation deviation defines a deviation of ratings by other 
10 entities of the rated entity from an expected rating, and is described in more detail below 
in relation to Fig. 6. Thus, a rating predictability for the first rating may be determined 
by applying the following equation: 

X 2 j£ ratee, others 

Equations Y> } (x) = — .e~,X= J ~ ^ , 

where RDjJ aiee is the ratee reputation deviation of the rated entity, and Pj(X) is 

15 the rating predictability of the first rating Wj. 

Dividing the absolute difference by the rates reputation duration has the effect of 
weighting the absolute difference over the ratee reputation deviation. This weighting 
may be desirable to account for the stability or reliability of rater ratings of the rated 
entity in determining the rates reputation of the first entity. For example, if the ratee 

20 reputation of the rated entity is unstable (i.e., ratings provided for the rated entity vary 
considerably), the rater reputation of the first entity should be changed less by the 
difference between the expected rating and the first rating. Conversely, if the ratee 
reputation of the rated entity is stable, the rater reputation of the first entity should be 
changed less by the difference. 

25 Alternatively, other functions may be applied to determine the rating 

predictability of the first rating. For example, the absolute difference may be subtracted 
from a constant such as, for example, a constant representing a maximum allowed rater 
reputation value. For example, if the range of allowed rater reputation values is from 0 
to 1, then the absolute difference between the first rating and the expected rating may be 

30 subtracted from 1, such that the rating predictability is a negative function of the absolute 
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difference. Accordingly, the rating predictability of the first rating may be determined 
by applying the following equation: 



Equation 10 : P } (x) = 1 - \w. - E 



ratee ^others I 



( RD ™*^ 

min 

r> r\ ratee 

K RD M ) 



30 



where RD min ratee is the minimum allowed ratee reputation deviation. Other 
methods may be used to determine a rating predictability of an entity. 

If the first rating is a first-time rating by the first entity, then the generated rating 
predictability may alone serve as the rater reputation of the first entity. 

-A4*f>«»ativfr1y j jf the firs ^ H i ti t y I i jik prnuiilml l\ t ]\k*r rnting of ntVier pntitip^ anH 

rating predictabilities have been generated from these other ratings (e.g., bypertorming 
Acts 2 and 4 on the provided ratings), then, in Act 5, the other ratirig^pfedictabilities may 
be combined with the rating predictability generated in^^t^Tto produce the rater 
reputation of the first entity. Act 5 may be impletfiented in any of several different ways. 
In one implementation, Act 5 may beip*j5lemented by averaging all of the generated 
rating predictabilities associa^ed-^vith each rating provided by the first entity. 
Accordingly, a raterj^splotation may be determined by applying the following equation: 

oationll: R mter = i -«VPfr) 



where n is the number of ratings provided by the first entity and R rater is the rater 
reputation. 

If the rater reputation of the first entity is determined by averaging the first 
entity's rating predictabilities, the average may be a weighted average. For example, 
each rating predictability may be weighted as a positive function of the time at which the 
rating associated with the rating predictability is provided. For example, the earlier the 
associated rating is provided, and thus the further away in time from when the rater 
reputation is being determined, the lower the weighting of the predictability. Optionally, 
each rating predictability may be placed in a temporal order according to the time at 
which its associated rating was provided, and each predictability may be weighted 
according its position in this order. Further, time may be divided into a number of 
intervals, and the temporal intervals may be placed in a temporal order. A rating 
predictability then may be weighted according to the position of the temporal interval in 
the temporal order. 
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Weighting the rating as such represents the principle that an entity's rater 
reputation may change over time, and thus more recent ratings should be given more 
weight than older ratings in determining the rater reputation of an entity. A rater 
reputation, determined by applying such a weighted average of predictabilities, may be 
5 determined by applying the following equation: 

^Pj{X).f{j) 
Equation 12 : R raUir = 

Z/C7) 

>l 

where f(j) is a temporal function such as, for example: 

Equation 1 3 : f(J ) = , 

V J 

where V\s a constant number having a value < 1, and j is the position of rating 
10 predictability, Pj 9 in a temporal order, or a time at which the rating associated with the 
predictability was provided, or a position in a temporal order of a temporal interval 
during which the associated rating was made. Other weightings and combinations of 
weightings may be applied to an average predictability to determine a rater reputation of 
an entity such as, for example, a combination of entity reputations associated with each 
15 predictability, described in detail below in relation to Act 10. 

Determining a rater reputation of a first entity by averaging rating predictabilities 
of the first entity may become more cost prohibitive as the number of ratings of other 
entities provided by the first entity increases. 

Accordingly, as an alternative implementation of Act 5, the rater reputation may 
20 be determined recursively. Determining a rater reputation recursively, for example, as 
described below, saves computational space and time, particularly as the number of 
ratings of other entities provided by the first entity grows. 

Such a recursive determination may include: providing a previously determined 
rater reputation (i.e., an initial rater reputation) of the first entity; determining a rater 
25 reputation adjustment (which may be a positive or negative value) based on the 

generated rating, and adding the reputation adjustments to the previously determined 
rater reputation to produce the rater reputation. 
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Fig. 3 is a flow chart illustrating an example implementation of Act 5. In Act 6, 
the rating predictability may be subtracted from the initial rater reputation to produce a 
reputation modification. Next, in Act 8, the reputations of the entities that provided the 
selected second ratings may be combined to produce a combined reputation such as, for 
5 example, by calculating an average reputation from these reputations. For example, a 
combined reputation may be determined by applying following equation: 

k g other 

Equation 14: R = Y — — , 

1 combined A— J U. j 

+ l It J 

where R CO mbmed is the combined reputation and R u other is the rating of an entity that 
provided one of the selected second ratings. Act 8 may be performed in sequence or 

10 concurrently with Acts 2-6. 

Next, in Act 10, the reputation modification may be scaled by the combined 
reputation to produce a scaled reputation modification. This scaling has the effect of 
weighting the reputation modification according to the reputations of the entities 
corresponding to the second ratings. If the combined reputation is an average reputation 

15 of the entities that provided the selected second ratings and has a relatively high value, 
then the reputation modification is scaled such that the reputation adjustment is relatively 
high. Conversely, if the average rater reputation of these raters is relatively low, then the 
reputation adjustment resulting from the scaled reputation modification is relatively low. 
The scaled reputation modification may be determined by applying the following 

20 equation: 

Equations: R scaleJ = R comhined [ p (X) ~ R™ r ]> 

where Rj.j rater is the initial rater reputation, [P(X)-Rj. } rater ] is the reputation modification, 

25 and Rscaied is the scaled reputation modification. 

Next, in Act 12, the scaled reputation modification maybe divided by a change 
rate factor to produce a reputation adjustment. This change rate factor controls the rate 
at which the first rating and the resulting rating predictability can change the rater 
reputation of the first entity. For example, if the rate change factor has a high value, then 

30 the rate of change will be slower such that a relatively higher number of ratings will have 
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to be provided by an entity before the rater reputation of the entity approaches an Actual 
reputation of the entity. 

Next, in Act 14, the reputation adjustment is added to the initial rater reputation 
to produce a resulting rater reputation. The resulting rater reputation may be determined 
5 by applying the following equation: 

Equation^: R; lCT = R™ +^R xcaled , 

where 1/C is the change rate factor and R/ ater is the resulting rater reputation. The 
change rate factor is named as such because its value impacts the rate at which the rater 
reputation changes value. Optionally, the value of C may be set equal to the value of T Q , 

10 the effective number of observations, described below in relation to Equations 19 and 20. 
In an aspect of recursively determining a rater reputation of an entity, for 
example, by applying Equation 16, an original rater reputation (i.e., an entity's rater 
reputation before a first rater reputation has been determined for the entity), Ro rater , is 
initialized to zero. Consequently, an entity's rater reputation has its lowest value before 

15 the entity provides a first rating of another entity. Such an original rater reputation 

prevents an entity with a low rater reputation from creating a new identity as a new entity 
and beginning with a higher rater reputation than the low reputation of the entity. 

Recursively determining a rater reputation of a first entity, for example, by 
applying Equation 1 6, may result in an rater reputation that asymptotically approaches an 

20 Actual rater reputation of the first entity as the number or ratings of other entities 

provided by the first entity increases. An Actual rater reputation of the entity may be 
determined by averaging the determined rating predictabilities (and possibly weighting 
the average) for each rating provided by the first entity, for example, by applying 
Equation 1 1 or 12, or a variation thereof As described above, this averaging may 

25 become cost prohibitive as the number of ratings provided by the first entity increases. 
Further, this averaging does not penalize an entity from starting over as a new entity by 
initializing to zero an original rater reputation of the entity. Both of these shortcomings 
of calculating an Actual reputation are avoided by initializing to zero an original rater 
reputation of an entity and by recursively determining the rater reputation of the entity, 

30 for example, by applying Equation 16 and variations thereof 

In an aspect of recursively determining a rater reputation of an entity, in response 
to receiving a rating of a rated entity, the rater reputations of the entities that provided the 
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most recent M ratings may be determined. In other words, each of the selected second 
ratings is one of the most recent M ratings. 

Further, the determined rater reputation for each rating entity may be weighted as 
a function of how recent the rating entity provided its rating in relation to how recent the 
5 other rating entities provided their ratings. For example, for each of rating entities 
corresponding to one of the last M ratings received, the rating entity's rater reputation 
may be determined by application of the following equation: 



where Mis the number of most recent ratings, m is the number of ratings (of the 
most recent ratings) received after the rating received from the rating entity plus 1 (i.e., 
for the rating entity that provided the most recent rating, the value of m = 1), and 
R(m) sca i e d is the scaled rater reputation modification as described above in relation to 
15 Equation 16, where, for the expected rating (as described in relation to Equation 8) from 
which the scaled rater reputation modification is generated, k-j=rn. 

J^Qg-^xampk^- if rater rep ut a t ions aic b e ing de termin e d for the rnt^g w^^^- 
provided the most recent 20 ratiiig%^henr^^lT For the rating entity that provided the 
earliest rating^jrz^^fTand m/M= 1 . Further, for the rating entity that provided the most 
20 rggefrt'¥^ing y -xft-= s - l and m/M - 1 1 - /20. 1 

By weighting the adjustment to the rater reputation of an entity by m/M, the 
amount that a rating entity's rater reputation is adjusted is proportional to the number of 
ratings received for a rated entity after the rating provided by the rating entity. This 
weighting reflects the principle that if there are more ratings received after the rating 
25 provided by the rating entity, then there is more information to estimate the predictability 
of the rating entity, as described above in relation to Equations 9 and 10, from which the 
rater reputation adjustment is determined. This use of more information results in more 
accurate estimations of the predictability of the rating entity, and a more accurate rater 
reputation adjustment. Accordingly, by weighting the rater reputation adjustment as 
30 described above in relation to Equation 17, the rater reputation adjustment is weighted as 
a function of this accuracy. 
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Other techniques may be used for weighting a rater reputation adjustment as a 
function of how recent the rating entity provided its rating in relation to how recent the 
other rating entities provided their ratings. 

As described above, in an aspect of determining a rater reputation of an entity, 
5 each time a new entity enters a population or community of entities that use a rating 
system incorporating rater reputation, the new entity may have an original rater 
reputation initialized to zero. Initializing an original rater reputation to zero may be 
desirable if an entity is capable of having multiple identities. In a system where an entity 
is restricted to a lifetime persistent identity, for example, a social security number, then 

10 the original rater reputation may not be initialized to zero, but may be initialized to 

another value. For example, the original rater reputation may be initialized to an average 
rater reputation value. 

In some situations, an entire population of entities that have been using a rating 
system to rate each other, and thus have pre-collected ratings, may want to determine a 

1 5 rater reputation of one or more, possibly all, entities of the population using these pre- 
collected ratings. Such determination of rater reputations for a population of entities 
using pre-collected ratings may be referred to herein as "seeding" a reputation system. If 
seeding a reputation system, one or more first entities of the population may not have 
provided a sufficient number of ratings of other entities such that a recursively generated 

20 rater reputation of these first entities approximates an Actual rater reputation of these 
first entities, respectively. Consequently, the resulting rater reputation of one or more 
first entities that have provided relatively few ratings is lower than the resulting 
reputation of one or more first entities that have provided relatively many ratings, 
irrespective of the Actual ratings provided by the first entities. 

25 Accordingly, in an aspect of seeding a reputation system by recursively 

determining a rater reputation of a first new entity, pre-collected ratings may be used to 
determine the rater reputation as follows. In a first pass of determining the rater 
reputation, for example, by applying Equation 1 6 or variations thereof, the pre-collected 
ratings are used and the original rater reputation of the first new entity may be initialized 

30 to zero. A second pass of determining the rater reputation may use the same pre- 
collected ratings and initialize the original rater reputation of the first new user to the 
rater reputation resulting from the first pass. This initialization to a resulting reputation 
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may be repeated in other passes until the resulting reputation adequately approximates 
the Actual rater reputation of the first new entity. * 

' Further, to seed a re p utation system by recursively de t ermining a rater rcputatii 
of a first entity, the expected rating for each first rating provided by Jlie-ftrSf entity may 
be determined by applying the following equation: 

1 




Equation 1 8 : 



/-l+C/2 
g ratee * ^ X 1 rate± 

' ~D 

where JZ,-./ is thej^te^reputation of the rated entity at /-i, D is the range of 
allowed r§put£fibn values, 1/C is the change rate factor and Ei ratee is the determined 
5ect rating. 

10 Fi g , 4 ip fl H&fo -^k nx/ ^li n grar" illustrating nn nvnmpln m i l i i u l i i |j i\[ r \ i ^kj^ j- 

for generating a rater reputation 38. The rater reputation generatoiH^U may receive a 
request 21 from a user indicating a request for a first eptity^s reputation. In response to 
the user request 21, the rater reputation gener^kffzO may receive as input a first rater 
rating 26 and selected second ratings^87and generate the resulting rater reputation 38 as 
15 output, for example, by pgrfefming Acts 2-5 of Fig. 3. In one implementation, the rater 
reputation gener^tefzO may also receive as input other rating predictabilities 49 to 
generate^fesulting rater reputation 38 by averaging rating predictabilities, as described 
-hrrelation-te-Ftgr-3. 
In another implementation, the rater reputation generator 20 may also receive as 
20 input an initial rater reputation 22, other rater reputations 24, a ratee reputation deviation 
30, a range 32, and a change rate factor 34, and use these inputs in addition to inputs 26 
and 28 to generate a resulting rater reputation 38 such as, for example, by applying Acts 
6-14 of Fig. 3. 

In yet another implementation, the rater reputation generator further may receive 
25 a value 3 1 indicating a number of most recent ratings and a value 33 indicating the 

number of ratings provided for the rated entity after the first rater rating 26 was provided. 
Values 31 and 33 correspond to values M and w, respectively described above in 
relation to Equation 17. 

Fig. 5 is a data flow diagram illustrating a more detailed example embodiment of 
30 the system 19 for generating a resulting rater reputation 38. The rater reputation 

generator 20 may include an expected rating generator 40, a predictability generator 44, a 
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reputation modification generator 48, a combined predictability generator 47, a 
combined reputation generator 52, a reputation adjustment generator 56 and an adder 60. 

In response to the rater reputation generator 20 receiving the user request 21, the 
expected rating generator 40 may receive as input the selected second ratings 28 and 
5 generate as output an expected rating 42. The expected rating generator 40 also may 

receive as input other rater reputations 24, and use this input 24 in addition to input 28, to 
generate the expected rating 42. The other rater reputations 24 may be the reputations of 
the entities that provided the selected second ratings 28. Expected rating generator 40 
may generate expected ratings 42 in accordance with the various techniques described 

10 above in relation to Act 2 of Fig. 2. 

The predictability generator 44 may receive as input the expected ratings 42 and 
the first rater rating 26 and produce a rating predictability 46 as output. The 
predictability generator 44 also may receive the ratee reputation deviation 30 and the 
range 32, and use both of these inputs to help produce the rating predictability 46. The 

15 predictability generator 44 may generate the rating predictability 46 in accordance with 
the various techniques discussed above in relation to Act 4 of Fig. 2. 

The rater reputation of a first entity may be determined according to Equations 1 1 
or 12 by including in the rater reputation generator the combined predictability generator 
47 that receives as input rating predictability 46 and other rating predictabilities 49 

20 (which may have been generated by predictability generator 44) and generates as output 
a resulting rater reputation 38. 

The reputation modification generator 48 may receive a rating predictability 46 
and an initial rater reputation 22, and generate a reputation modification 50. The 
reputation modification generator 48 may generate the reputation modification 50 by 

25 subtracting the rating predictability from the initial rater reputation as described above in 
relation to Act 6 of Fig. 3. 

The combined reputation generator 52 may receive other rater reputations 24 and 
generate a combined reputation value 54. The combined reputation generator 52 may 
calculate the average of the other rater reputations to determine the combined reputation 

30 54. 

A reputation adjustment generator 56 may receive the combined reputation 54 
and the reputation modification 50 and generate a reputation adjustment 58. The 
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reputation adjustment generator 56 may also receive the change rate factor 34. The 
reputation adjustment generator 56 may generate the reputation adjustment 58 in 
accordance with the techniques described above in relation to Acts 10 and 12 of Fig. 3. 
As described above, the combined reputation 54 may scale the reputation modification 
5 50 in accordance with the combined reputation 54 of the other raters. 

In an embodiment, the reputation adjustment generator further receives values 31 
and 33 corresponding to values Mand m, respectively, and generates the rater reputation 
adjustment 58 as described above in relation to Equation 17. 

The adder 60 may add the initial rater reputation 22 to the reputation adjustment 

10 58 to produce the resulting rater reputation 38. 

The rater reputation generator 20 and any components thereof, including 
expected rating generator 40, predictability generator 44, combined reputation generator 
52, combined predictability generator 47, reputation modification generator 48, 
reputation adjustment generator 56 and adder 60, may be implemented as software, 

1 5 hardware, firmware or any combination thereof. The rater reputation generator 20 and 
any components thereof may reside on a single machine (e.g., a computer), or may be 
modular and reside on multiple interconnected (e.g., by a network) machines. Further, 
on each of the one or machines that include the rater reputation generator 20 or a 
component thereof, the generator 20 or component may reside in one or more locations 

20 on the machine. For example, different portions of the rater reputation generator 20 or 
different portions of a component may reside in different areas of memory (e.g., RAM, 
ROM, disk, etc.) on a computer. 

The range 32 and the change rate factor 34 may be constants for the system 19 
and may be stored in a reputation database or other data structure, as described in more 

25 detail below in relation to Fig. 1 8. The first rater rating 26, the other reputations 24, the * 
selected second ratings 28, the ratee reputation deviation 30, the initial rater reputation 
22, and values 3 1 and 33 also may be stored in the reputation database or other structure. 
In response to receiving the user request 21, the rater reputation generator 20 may access 
the reputation database or similar data structure and retrieve values 26, 32, 24, 28, 26, 30, 

30 31, 32, 33 and 34 to generate the resulting rater reputation 38 as described above. The 
resulting rater reputation 38 then may be stored in the reputation database or other data 
structure for later access. 
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System 19, and the components thereof, are merely example embodiments of a 
system for generating a rater reputation. Such example embodiments are not meant to 
limit the scope of the invention and are provided merely for illustrative purposes, as any 
of a variety of other systems and components for determining a rater reputation, 
5 determining a may fall within the scope of the invention. 

II. Determining a Ratee Reputation Deviation 

Fig. 6 is a data flow diagram illustrating an example embodiment of a system 69 
for recursively generating the ratee reputation deviation 30 of a rated entity. Similarly to 

10 as described above in relation to recursively determining a rater reputation, determining a 
ratee reputation deviation recursively saves computational space and time, particularly as 
the number of provided ratings for the rated entity grows. 

The ratee reputation deviation generator 72 may receive as input a ratee 
reputation 70, a rater reputation 74, an initial ratee reputation deviation 75, a most recent 

15 rating 76 and a forgetting factor 77. The ratee reputation deviation generator 72 may 
also receive the range 32. 

The ratee reputation 70 is the ratee reputation determined from the most recent 
rating 76 of the rated entity, for example, by applying Equation 1 as disclosed in the 
Zacharia thesis, or by applying a variation of Equation 1 , where the rater reputation is 

20 determined in accordance with Equation 1 5 or a variation thereof, as described above in 
relation to Fig. 2. The initial ratee reputation deviation 75 is the ratee reputation 
deviation of the rated entity before the most recent rating 76 was provided. The rater 
reputation 74 is the rater reputation of an entity that provided the most recent rating 76. 
The ratee reputation generator 72 may generate from these inputs the ratee reputation 

25 deviation 30 that represents a reliability of the rated entity's ratee reputation. 

Optionally, the ratee reputation deviation generator 72 also may receive a 
minimum allowed rater reputation deviation and compare it to the determined rater 
reputation deviation 30. If the minimum deviation is greater than deviation 30, then the 
rater reputation deviation 30 may be set equal to the minimum allowed rater reputation. 

30 Accordingly, the ratee reputation deviation generator 72 may generate the ratee 

reputation deviation 30 by applying the following equation: 
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Equation 1 9 : (RD™ tee J = max([7?D^ f , [f • (^D,^ ) 2 + (/?, m '" - E™ iee ' past )f j 

where RD m i n ratee is a minimum allowed ratee reputation deviation, F is the forgetting 
factor 172, RDi.f atee is the initial ratee reputation 75, Ri rater is the rater reputation 74, Wj 
5 is the most recent rating 76, To is an effective number of reputation determinations, 

j^rater.past j g ^ eX p ectec j rating, and RDi ratee is the resulting ratee reputation deviation 30. 
The expected rating may be calculated by applying Equation 2 as described in the 
Zacharia thesis. The forgetting factor is a constant having a value <1 such that older 
ratings have less weight in determining the resulting ratee reputation deviation than more 
10 recent ratings. T c may be derived from Fby applying the following equation: 

CO 1 

Equation 20 : T a = ^ F i = . 

/=o 1 - F 

Optionally, the effective number of determined reputations may be used to 
determine the change rate factor described above by setting C— To. 

Other statistical methods may be used to determine a reliability of a ratee 
1 5 reputation. For example, a forgetting factor may not be applied, or an average deviation 
may be determined for all determined ratee reputations of the rated entity, or such an 
average deviation may be calculated with each ratee reputation weighted according to 
how recent the ratee reputation was determined. 

In an aspect of recursively determining a ratee reputation deviation of a rated 
20 entity, for example, by applying Equation 19, an original ratee reputation deviation, 

RDj ratee , is initialized to a maximum allowed value for a ratee reputation deviation. Such 
a maximum value may be predetermined. Consequently, a rated entity's ratee reputation 
deviation has its highest value before the rated entity is rated by other entities. Assigning 
a maximum value to an original ratee reputation deviation prevents an entity with a high 
25 ratee reputation deviation from creating a new identity as a new entity and beginning 
with a more desirable lower ratee reputation deviation. 

-Eq ua t ion 1 9 may be cuiisideied "3~re cursivc estimation algorithm ofRccursi ve 
Least Squares (RLS) with a forgetting L factQiLo^ 2 r^^uation 1 9 estimates recursively an 
average square deviatian-ef*anactual rating from an expected (i.e., estimated) rating 
describec£i«~tnore detail below in relation to Figs. 8 and 9. For more information 

garding Rer u r S1V p T ^qpH Slqn ^ f^ pl^a . ™ ™for tn Phnptpr O nf'^L prtnrp J sTntes and V 
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Other statistical methods may be used to determine a reliability of a ratee 



reputation. For example, a forgetting factor may not be applied, or an average deviation 
may be determined for all determined ratee reputations of the rated entity, or such an 
average deviation may be calculated with each ratee reputation weighted according to 
how recent the ratee reputation was determined. 



hardware, firmware or any combination thereof The ratee reputation deviation generator 
72 may reside on a single machine (e.g., a computer), or may be modular and reside on 
multiple interconnected (e.g., by a network) machines. Further, on each of the one or 
more machines that include the ratee reputation deviation generator 72 or modules 

15 thereof, the generator 72 or modules may reside in one or more locations on the machine. 
For example, different portions of the ratee reputation deviation generator 72 or modules 
may reside in different areas of memory (e.g., RAM, ROM, disk, etc.) on a computer. 

The range 32 and the forgetting factor 77 may be constants stored in a reputation 
database or similar data structure as described in more detail in relation to Fig. 1 8. The 

20 ratee reputation 70, the rater reputation 74, and the initial ratee reputation deviation 75 
also may be stored in the reputation database or similar structure. The ratee reputation 
deviation generator 72, in response to receiving the most recent rating 76, may access the 
reputation database or similar structure to generate the ratee reputation deviation 30 as 
described above. The ratee reputation deviation 30 then may be stored in the reputation 

25 database or similar structure for later access. 

System 69 is merely an example embodiment of a system for generating a ratee 
reputation deviation. Such an example embodiment is not meant to limit the scope of the 
invention and is provided merely for illustrative purposes, as any of a variety of other 
systems for determining a ratee reputation deviation may fall within the scope of the 

30 invention. 



10 



The ratee reputation deviation generator 72 may be implemented as software, 
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III. Determining a Rater Reputation Deviation 

In addition to having an estimate of the reliability of the ratee reputation, for 
example, the ratee reputation deviation 30, it may be desirable to have an estimate of the 
reliability of the rater reputation of an entity that is providing a rating. Such a reliability 
5 may be estimated by calculating of a rater reputation deviation. Similarly to as described 
above in relation to ratee reputation deviation, computational space and time may be 
saved by calculating a rater reputation deviation recursively, particularly as the number 
of ratings of other entities provided by the first entity increases. 

Accordingly, a rater reputation deviation may be determined recursively by 
10 applying the following equation: 

Equation21: (RD^f = mB^T f , • [XD]? )* +*LwR)> 

where RD m i n rater is a minimum allowed rater reputation deviation, RDj./ ater is an initial 
15 rater reputation deviation, RDf ater is the resulting rater reputation deviation, and the other 

symbols are as described above. 

Equation 21, and variations thereof, estimate recursively an average square 

deviation of a rater reputation of an entity from an expected (i.e., estimated) rater 

reputation. For each recursive estimate, the initial rater reputation deviation, RDj.{ ater y 
20 may be weighted by the forgetting factor, F 9 and the average square deviation may be 

divided by the effective number of determined reputations, To. Such recursive estimation 

is described in more detail in chapter 9 of the Madsen text. 

Other statistical methods may be used to determine a reliability of a rater 

reputation. For example, a forgetting factor may not be applied, or an average deviation 
25 may be determined for all determined rater reputations of the rating entity, or such an 

average deviation may be calculated with each rater reputation weighted according to 

how recent the rater reputation was determined. 

In an aspect of recursively determining a ratee reputation deviation of a first 

entity, for example, by application of Equation 21, an original rater reputation deviation, 
30 RDj rater , is initialized to a maximum value. This maximum value may be predetermined. 

Consequently, a first entity's rater reputation deviation has its highest value before the 

first entity provides a first rating of another entity. Assigning a maximum value for the 
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rater reputation deviation prevents a first entity with a high rater reputation deviation 
from creating a new identity as a new entity and beginning with a lower rater reputation 
deviation. 

' Fig. 7 is a data flow diagram illustratin g un example embodiment o f a cystemjb^ 
5 generating a rater reputation deviation. A raterj^egulali©fi-dev^ 82 may 

receive as input an initial mtgj^epTltation22 5 a rating predictability 46, an initial rater 
^ reputation de>iaritSir80^r^a forgetting factor 34. Rater reputation deviation generator 
S^atSe may receive other - r ater rcputa nons 24. 

The rater reputation deviation generator 82 may generate the rater reputation 
10 deviation 84 from inputs 22, 24, 46 and 80. Alternatively, in place of inputs 22, 24 and 
46, deviation generator 82 may receive the scaled reputation modification as input and 
generate the rater reputation deviation 84 in accordance with Equation 21 or variations 
thereof. 

Optionally, the rater reputation deviation generator 82 may receive a minimum 
15 allowed rater reputation deviation, RD rater min , and compare it to the determined rater 

reputation deviation 84. If the minimum deviation is greater than deviation 84, then the 
rater reputation deviation 84 may be set equal to the minimum allowed rater reputation. 

The rater reputation deviation generator 82 may be implemented as software, 
hardware, firmware or any combination thereof. The rater reputation deviation generator 
20 82 may reside on a single machine (e.g., a computer), or may be modular and reside on 
multiple interconnected (e.g., by a network) machines. Further, on each of the one or 
more machines that include the rater reputation deviation generator 82 or modules 
thereof, the generator 82 or modules thereof, the generator 82 or modules may reside in 
one or more locations on the machine. For example, different portions of the rater 
25 reputation deviation generator 82 may reside in different areas of memory (e.g., RAM, 
ROM, disk, etc.) on a computer. 

The-fbrgetting iactor J 4 may be stored as a constant in a reputation databases* 
similar data structure as described below in relation to Fig. IJ^JXhe^frili^ 
reputation 22, the rating predictability 46 ! Jh£j5therfater reputations 24 and the initial 
0 rater reputation deviationj£0-afe5lnay be stored in the reputation database or similar data 
structure^Jft^esponse to receiving the rating predictability 46, the rater reputation 
f tfvintion £en nvili n ft? may mr ^ss \hr f^ pu l.il i ' M i dntnhnr^ ^r girmlpr Hat^ <?tmrtur f t o - 
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prce^ nnd retrie ve values 22. 24. 80 and 34, and ge n ^ rgt ^ rat^r r^pptQti'rtrwL^i4Lii4iT"ft*-y 
The rater reputation^deiaatieiT-8^ database or similar 

.st raCfurefop -terter access. 

System 79 is merely an example embodiment of a system for generating a rater 
reputation deviation. Such an example embodiment is not meant to limit the scope of the 
invention and is provided merely for illustrative purposes, as any of a variety of other 
systems and components for determining a rater reputation deviation may fall within the 
scope of the invention. 



IV. Determining a Ratee Reputation Using a Rater Reputation 

If a rater reputation is determined for a first entity, and the first entity provides a 
first rating of a rated entity, the rater reputation and the first rating may be used to 
determine, at least in part, a ratee reputation of the rated entity. 

Accordingly, provided herein is a method and system for determining a ratee 
reputation of a rated entity based at least in part on one or more ratings of the rated entity 
provided by one or more entities and the rater reputations of these one or more entities. 

In one embodiment of determining a ratee reputation, the ratee reputation of a 
rated entity is determined by averaging all of the ratings provided by other entities for the 
rated entity, and by weighting each rating with the rater reputation of the entity that 
provided the rating, to produce a weighted average. Accordingly, a ratee reputation may 
be determined by applying the following equation: 

Equation 22 : R mlee = -^— n , 

where Wj is a rating supplied, Rj rater is the rater reputation of the entity who 
provided the rating Wj. 

In generating such a weighted average, each rating may be further weighted with 
a positive function of the time at which the rating was provided. For example, the earlier 
the rating is provided, and thus the further away in time from when the ratee reputation is 
being determined, the lower the weighting of the rating. Optionally, each rating may be 
placed in a temporal order according to the time at which the rating was provided, and 
each rating may be weighted according its position in this order. Further, time may be 
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divided into a number of intervals, and the temporal intervals may be placed in a 
temporal order. A rating then may be weighted according to the position of the temporal 
interval in the temporal order. 

Similar to as described above in relation to determining a rater reputation, 
5 temporally weighting each rating represents the principle that an entity's ratee reputation 
may change over time. Thus, more recent ratings should be given more weight than 
older ratings in determining the ratee reputation of an entity. Accordingly, a ratee 
reputation may be determined by applying the following equation: 

Equation 23 : R """" = ^=L _ 1 

10 where f(j) is a temporal function such as, for example, Equation 12, above. Other 

weightings and combinations of weightings may be applied to a rating to determine a 
ratee reputation of an entity. 

Determining a ratee reputation of an entity by averaging ratings may become 
more cost prohibitive as the number of ratings provided by other entities for the first 

1 5 entity increases . 

Accordingly, in another embodiment of determining the ratee reputation of an 
entity, the ratee reputation may be determined recursively. Similarly to as described 
above in relation to determining a rater reputation, determining the ratee reputation 
recursively saves computational space and time, particularly as the number of ratings 

20 provided for the rated entity increases. 

A recursive determination may include: providing a previously determined ratee 
reputation (i.e., an initial ratee reputation) of the entity; determining a ratee reputation 
adjustment (which may be a positive or negative value) based on a received rating, and 
adding the reputation adjustments to the previously determined rater reputation. 

25 Fig. 8 is a flow chart illustrating an example implementation of a method of 

recursively determining a ratee reputation of an entity. In Act 90, an expected rating 
may be determined from the range and the ratee 's initial reputation. An expected rating 
may be determined by applying Equation 4 or a variation thereof. 



10 



20 
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Next, in Act 92, the expected rating may be subtracted from the first rating to 
produce a ratee reputation modification. The ratee reputation modification may be 
produced as described in relation to Equation 23 below. 

Next, in Act 94, the ratee reputation modification may be scaled by a rater 
reputation of the rating entity to produce a scaled ratee reputation modification. This 
rater reputation may be the resulting rater reputation generated according to one of the 
methods described in relation to Figs. 2 and 3, or a variation thereof. 

Combining Acts 92 and 94, the scaled ratee reputation modification may be 
produced by applying the following equation: 

Equation 24 : Rf calcd = R™' er • -E,\ 



where R[ ater is the rater reputation, W\ is the first rating, E t is the expected rating, and W- t 
Ei is the ratee reputation modification. 
15 Next, in Act 96, the scaled ratee reputation modification may be damped by a 

damping factor to produce a damped ratee reputation modification. The damped ratee 
reputation modification may be produced by applying the following equation: 



Equation 25 : 7? damped = damp(R™? e )• R; 



scaled 



where Ri-{ atee is the initial ratee reputation, and damp(Ri.{ atee ) is the damping factor. 

Optionally, the damping factor may be determined (in series or concurrently with Acts 

90-94) by applying Equation 2, where the acceleration factor, a, may be predetermined 

to control the rate at which the ratee reputation can change. 
25 In a next Act 98, the damped ratee reputation modification may be divided by a 

change rate factor to produce a ratee reputation adjustment. The change rate factor 

affects the rate at which the ratee reputation may change. 

Next, in Act 1 00, the ratee reputation may be added to the initial ratee reputation 

to produce a resulting ratee reputation. In accordance with Acts 98 and 100, the resulting 
30 ratee reputation may be determined by applying the following equation: 

Equation 26 : /?, ratee = R f _ } + ~ • 7? damped , 
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where C is the change rate factor and R[ a ee is the resulting ratee reputation. 

In an aspect of recursively determining a ratee reputation of an entity using one 
or more rater reputations, for example, by applying Equation 26, an original ratee 
reputation, Ro rater , for the entity has its lowest value before any ratings are provided for 
5 the entity. Assigning a lowest value to an original ratee reputation prevents an entity 
with a low ratee reputation from creating a new identity as a new entity and beginning 
with a higher ratee reputation. 

Other methods of determining a ratee reputation may be used. 

A ratee reputation of a first entity may be used for a variety of purposes, 
10 including determining whether to transact with the first entity, determining a price to pay 
for a good or service of the first entity and determining a price to pay for insuring a 
quality of a good or service of the first entity. 

Fig. 9 is a data flow diagram illustrating an example embodiment of a system 109 
for generating a resulting ratee reputation 140. A ratee reputation generator 110 may 
15 receive an acceleration factor 1 12, a range 32, an initial ratee reputation 1 14, a first 

rating 1 16, a rater reputation 118 and a change rate factor 120, and generate a resulting 
ratee reputation 140 as output. 

The ratee reputation generator 110 may include a damping factor generator 130, 
an expected rating generator 122, a ratee reputation modification generator 126, a ratee 
20 reputation adjustment generator 134 and an adder 138. 

The expected rating generator 122 may receive as input the range 32 and the 
initial ratee reputation 114, and generate an expected rating 124, for example, by 
applying Equation 3. The ratee reputation modification generator 126 may receive the 
first rating 116 and the expected rating 124, and generate the ratee reputation 
25 modification 128, for example, as described above in relation to Equation 23. 

The damping factor generator 130 may receive the acceleration factor 112, the 
initial ratee reputation 114 and the range 32, and generate the damping factor 132, for 
example, by applying Equation 3 above. 

The ratee reputation adjustment generator 134 may receive the ratee reputation 
30 modification 128, the damping factor 132, the rater reputation 118 and the change rate 
factor 120 and generate the ratee reputation adjustment 136, for example, by applying 
Equation 25 above. 
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The adder 138 may receive the initial ratee reputation 1 14 and the ratee 
reputation adjustment 136 and generate the resulting ratee reputation 140, for example, 
by applying Equation 26 above. 

Although not shown in Fig. 9, the system 109 also may include a transaction 
5 module such as transaction module 528 described below in relation to Fig. 1 1 . The 

transaction module may receive the resulting ratee reputation 140, determine whether to 
transact with the rated entity based on the resulting ratee reputation, find then output a 
value, for example, a boolean value, which indicates whether or not to transact with the 
rated entity. 

10 The ratee reputation generator 110, and any combination of its components 110, 

122, 126 and 134 may be implemented using software, firmware or hardware, or any 
combination thereof. The ratee reputation generator 110 and any components thereof 
may reside on a single machine (e.g., a computer), or may be modular and reside on 
multiple interconnected (e.g., by a network) machines. Further, on each of the one or 

15 machines that include the ratee reputation generator 1 10 or a component thereof, the 
generator 1 10 or component may reside in one or more locations on the machine. For 
example, different portions of the ratee reputation generator 1 1 0 or different portions of a 
component may reside in different areas of memory (e.g., RAM, ROM, disk, etc.) on a 
computer. 

20 The acceleration factor 1 12, the range 32 and the change rate factor 120 may be 

stored as constants in a reputation database or similar data structure as described below 
in relation to Fig. 18. The initial ratee reputation 114 and the rater reputation 118 may 
also be stored in the reputation database or similar data structure. In response to 
receiving the first rating 116, the ratee reputation generator may access the reputation 

25 database and retrieve values 112, 32, 114, 116, 118 and 120 to generate the resulting 

ratee reputation 140 as described above. The resulting ratee reputation 140 then may be 
stored in the reputation database or similar structure for later access. 

System 109, and components thereof, are merely example embodiments of a 
system for generating a ratee reputation. Such example embodiments are not meant to 

30 limit the scope of the invention and are provided merely for illustrative purposes, as any 
of a variety of other systems and components for determining a ratee reputation may fall 
within the scope of the invention. 
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V. Determining a Reputation of an Entity From a Perspective of Another Entity 

Fig. 10 is a flowchart illustrating an example embodiment of a method for 
determining a personalized ratee reputation. In a first Act 402, a breadth-first search is 
5 performed beginning at the second entity to determine, from one or more rating paths, 
one or more first rating paths that have a first length. In a next Act 404, for each 
determined first rating path, a third entity that has a level equal to or less than the first 
length is identified. 

• In u n e xt Act 406, foi each identifie d third party, a fust lating of the first identit y, 
10 provided by the third entity is determined. For eachJdeijlifieeHh^ be 

determined that the third entity h^pjxw?4dSffmore than one rating of the first entity. For 
each third entity forjyhiehiflias been determined that more than rating has been 
provide^a-nlost recent rating may be selected from the one or more ratings to serve as 

t ^n r Sl^P^li ' ^ * * r 11 n ■ f\r*Y ^nli ly provi<1^l-hy tho third nntity i 

15 In a following Act 408, the first ratings are combined. The first ratings may be 

combined in any of a variety of ways. In one embodiment, an average of the first ratings 
is calculated. Calculating this first average may include, for each first rating, weighting 
the first rating as a function of a personalized ratee reputation of the corresponding third 
entity from the prospective of the second entity. This weighting may be relative to 

20 personalized ratee reputations of the other third entities from the perspective of the 
second entity. 

The personalized ratee reputation of the third entity may be determined in any of 
a variety of ways. In one embodiment, one or more fourth entities that are on the first 
rating paths, that have provided a second rating of the third entity and that have a level 

25 equal to one less than the level of the third entity are determined. The second ratings 
provided by these one or more fourth entities are then combined to produce the 
personalized ratee reputation of the third entity from the perspective of the second entity. 
Combining the second ratings may include calculating an average of the second ratings. 
Optionally, Equation 4 or a variation thereof may be applied to combine the ratings. 

30 In a next Act 410, the personalized ratee reputation is produced by weighting the 

combined first rating as a function of the first length. Act 410 may be performed by 
application of the following Equation: 
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Equation 27 : R k (ri) = 



D«^.(«-l).^(«)]./(«) 

IX(«-i) 



A' 



' Where Rk(n) is tho personalized ratoo reputation of an entity k from a gcysp^ 
of a second entity a distance n from the entity Wjk(n) is a ratingprov^©d^5y an entity 7 
for the entity k, where the entity j is a distance n-1 fron^he^egprfd entity, Rj(n-l) is the 
personalized ratee reputation of the entity^fkrfnthe pgrsjJective of the second entity, D 
is a range of allowable person^Uzetfratee repujation valves, and f(n) is a function of the 
distances n betweejo4hg"second entity apsHne entity K (i.e., a function of the length of 
;paths between the second^tity and entity K), such as, for example: 



10 



15 



20 



25 



Equation 



f(n) = — 



-T4s-erconstallt number having a value > 1 .— 
This personalized ratee reputation may then be used to determine whether to 
transact with the first entity. 

"Weignting the persona lized idlcc ic p uldLiun as a function of the dis t ance Ja M a\^ 
the first and second entity, where the shorter^Lsto*K^~1fi^ the value of the 

weighting representgjjae-pfinciple that the less attenuated the rating path between a first 
and second^Sntity, the more likely the second entity is to trust the determined 

Hzed latee icputation. 

A personalized ratee reputation of a first entity may be used for a variety of 
purposes, including determining whether to transact with the first entity, determining a 
price to pay for a good or service of the first entity and determining a price to pay for 
insuring a quality of a good or service of the first entity. 

Fig. 1 1 is a data flow diagram illustrating an example embodiment of a system 
500 for determining a personalized ratee reputation of a first entity from the perspective 
of a second entity. The system 500 may include a personalized ratee reputation 
generator 506 and a transaction module 528. 

The personalized ratee reputation generator 506 may include a path-searching 
module 508, a first look-up module 514, a processing module 512, a second look-up 
module 520 and a ratings combiner 524. 
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The path-searching module 508 may receive an indication of the first entity 502, 
an indication of the second entity 504 and other ratings 517, and generate a signal 
indicating first rating paths 510. The path-searching module may determine the first 
rating paths 5 10 as described above in relation to Act 402 of Fig. 10. The path-searching 
5 module 508 may determine the first rating path 5 10 by searching or looking-up rating 
values in a ratings database or reputation database as described in more detail below in 
connection to Fig. 18. 

The first look-up module 514 may receive the indication of the first rating paths 
510 and generate third entities 518, for example, as described above in connection to Act 
10 404. The first look-up module 514 may determine the third entities 5 1 8 by looking up 
the third entities in a ratings or reputation database as described in more detail in relation 
to Fig. 18. 

The second look-up module 520 may receive the indication of the third entity 518 
as input and generate as output the first ratings 522, for example, as described above in 

15 relation to Act 406. The second look-up module 520 may determine the first ratings 522 
by looking up the first ratings in a ratings or reputation database, using the third entity 
518 as a look-up criteria, as described in more detail below in relation to Fig. 14. 

The processing module 512 receives the indication of the first rating paths 510 
and the indication of the third entities 518 and generates second ratings 516. The 

20 processing module 512 may generate the second ratings 516 as described above in 

relation to Act 410. The processing module 512 may determine the second ratings 516 
by looking up values in the ratings or reputation database described below in relation to 
Fig. 14, using the first rating paths 510 and the third entities 518 as search criteria. 

The ratings combiner 524 receives the first ratings 522 and the second ratings 516 

25 and generates the personalized ratee reputation 526. The ratings combiner 524 may also 
receive other ratings 517, which may have been generated in a similar manner to the first 
ratings 522 and the second ratings 516, for example, by applying Equation 27. The 
ratings combiner 524 may generate the personalized ratee reputation 526 as described 
above in relation to Act 410, and then may store the personalized ratee reputation in the 

30 reputation database or similar structure for later access. 

The transaction module 528 may receive the personalized ratee reputation 526, 
determine whether to transact with the first entity based on the personalized ratee 
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reputation, and then output a value, for example, a Boolean value 530, which indicates 
whether or not to transact with the first entity. The boolean rating 530 then may be 
stored in the reputation database or similar structure for later access. 

The transaction module 528, the personalized reputation generator 506 and any 
5 component thereof, including the path searching module 508, the first lookup module 
514, the second lookup module 520, the processing module 512 and the ratings combiner 
524, may be implemented as software, hardware, firmware or any combination thereof. 
The module 528, generator 506 and components thereof may reside on a single machine 
(e.g., a computer), or may be modular and reside on multiple interconnected (e.g., by a 

10 network) machines. Further, on each of the one or more machines that include the 

transaction module 528, personalized reputation generator 506 or a component thereof, 
the generator 506, transaction module 528 or component may reside in one or more 
locations on the machine. For example, different portions of the personalized reputation 
generator 506, different portions of a component, and different portions of the 

15 transaction module 528 may reside in different areas of memory (e.g., RAM, ROM, disk, 
etc.) on a computer. 

System 500, and components thereof, are merely example embodiments of a 
system for generating a personalized reputation generator and transacting based on the 
personalized reputation generator 506. Such example embodiments are not meant to 

20 limit the scope of the invention and are provided merely for illustrative purposes, as any 
of a variety of other systems and components for generating a personalized ratee 
reputation and transacting based thereon may fall within the scope of the invention. 

VI, Determining a Temporal Estimate of the Impact of One or More Attributes 
25 on an Overall Attribute or Result 

The methods and systems described above for determining a rater reputation, a 
rater reputation deviation, a ratee reputation, a ratee reputation deviation and a 
personalized ratee reputation are all described in the context of a single rating being 
provided for each exchange between a rating entity and a rated entity. 
30 Alternatively, in an aspect of rating an exchange, multiple ratings may be 

provided. For example, in an exchange involving the sale of a good, the rating entity 
may provide a rating for the quality of the good, a rating for the service quality, a rating 




-40- 



for the promptness of delivery and an overall rating for the exchange. If such multiple 
ratings are received for a single exchange, the systems and methods described above for 
determining reputations and deviations may be applied to each rating independently. For 
example, the rater reputation and rater reputation deviation of a rating entity as a rater of 
5 the quality of the good may be determined or the ratee reputation and ratee reputation 
deviation of a rated entity for the promptness of its delivery of goods may be determined. 

Further, if multiple ratings are received for a single exchange, and an overall 
rating is provided or a result based on the transaction occurs, it may be desirable to 
determine the impact of the one or more ratings on the overall rating or the result. It 

10 further may be desirable to determine the impact of these one or more ratings on an 
overall rating or results over time as ratings are received. 

Accordingly, a method and system for recursively estimating the impact of one or 
more attributes, e.g., ratings, on a result corresponding to a qualitative assessment, e.g., 
an overall rating, where the qualitative assessment is based on the one or more attributes, 

15 will now be described. Determining such a recursive estimate over time allows the 
impacts of one or more ratings to be incrementally corrected as more ratings are 
received. 

Although recursively estimating the impact of one or more attributes on a result is 
described below mostly in the context of ratings, the impacts of other types of attributes 

20 may be used. For example, one or more objective metrics may be assigned according to 
the quality of a good, the time of delivery, the cost of the good, etc., and the impact of 
this metric on a result or qualitative assessment may be determined. 

A result of a qualitative assessment may be the qualitative assessment itself such 
as, for example, feedback, a rating or a score, or may be an action taken as a result of a 

25 qualitative assessment such as setting a price or making a selection. For example, if 
several entities purchase a good from a seller, and each entity provides separate ratings 
for the quality of the good, the service quality and the promptness of delivery, and also 
provides an overall rating of the seller, it may be desirable to determine the impact of 
each rating on the overall rating. Subsequently, the impact of each rating may be applied 

30 to estimate the impact of future ratings on a future overall rating. 

It may be desirable to determine recursively a temporal estimate of the impact of 
one or more attributes of a plurality of attributes in any of the following scenarios: 
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a) Determining an overall rating; 

b) Setting a price of a narrowly defined service or item; 

c) Determining a frequency (i.e., a selectivity ratio) that a particular entity, 
item or service is selected when compared with other entities items or 

5 services; and 

d) Determining any other rating aspect, score, or other quality assessment for 
an entity, item, service, or policy that can be reduced to a numerical or 
Boolean state. 

Fig. 12 is a flow chart illustrating an example embodiment of a method 800 for 

10 estimating the impacts of a plurality of ratings on a result. In a first Act 802, a plurality 
of ratings provided for a first entity by a second entity in association with an exchange 
between the first and second entity are received. Each of these ratings corresponds to a 
respective rating parameter for the first entity. For example, rating parameters may 
include quality of service, speed of delivery and quality of a good, and the corresponding 

15 ratings may be 0.5, 0.7 and 0.2, respectively. 

In a next Act 804, a result based on the exchange between the first and second 
entity may be received. This result may correspond to a result parameter for the first 
entity. For example, the result parameter may be an overall rating or a price, and the 
corresponding result may be 0.7 or $7.95, respectively. 

20 In a following Act 806, for each received rating, a corresponding initial 

weighting value that corresponds to the rating parameter of the received rating is 
accessed. This initial weighting represents an estimated weight of the received rating for 
the rating parameter relative to received ratings for the other rating parameters in 
determining the result for the result parameter. For example, historically, the received 

25 ratings for the quality of a good sold by a first entity may have more weight in 

determining a price of the good than ratings received for the speed of delivery. For 
example, the speed of delivery may have a corresponding initial weighting value of 0.6, 
and the quality of the good may have a corresponding initial weighting value of 0.4. 
Next, in Act 808, an estimated result is determined by applying each initial 

30 weighting value to its corresponding receive rating. For example, if a rating of 0.6 is 
received for the speed of delivery and the rating of 0.4 is received for the quality of the 
good, and the speed of delivery has an initial weighting value 0.3 and the quality of the 




-42- 



good has an initial weighting value of .7, then the estimated result may be determined as 
(0.6) (0.3) + (0.4) (0.7) = .46. 

In a next Act 8 1 0, the estimated result may be compared to the received results to 
produce a weighting modification. For example, if the estimated result is .46, but the 
5 actual received result is .54, then the weighting modification may be .54 - .46 = .08. 

In a following Act 812, for each initial weighting value, the initial weighting 
value may be adjusted as a function of the weighting modification to produce a resulting 
weighting value for the corresponding rating parameter. For example, the weighting 
modification may be added to each initial weighting value. 
10 In an aspect of generating a resulting weighting value, the initial weighting values 

may be adjusted as a function of previous ratings provided for the rating parameters, for 
example, as described in more detail below in connection to Fig. 14. 

Fig. 13 is a data flow diagram illustrating an example embodiment of a system 
for estimating the impacts of a plurality of ratings on a result. The system 169 may 
15 include a ratings database 205 and a weightings generator 170 that includes a weighting 
modification generator 194 and a weighting adjuster 195. The ratings database 205 may 
be a reputation database or similar data structure such as described below in relation to 
Fig. 18. 

The weighting modification generator 194 may receive ratings 175 and a result 
20 178, access initial weighting values 179 corresponding to the ratings 175, and generate 
the weighting modification 196, as described above in Acts 802-810 of Fig. 12. The 
ratings 175 may be received along with a first entity ID 177 that identifies the first entity 
for which the ratings 175 are being provided. The weighting modification generator 194 
may access the initial weighting values 1 79 from the ratings database 205 using the first 
25 entity ID 177. In an embodiment, the weighting modification generator 194 may 

generate the weighting modification 196 as described above in relation to Act 156 of Fig. 
14. 

The weighting adjuster 195 may receive the weighting modification 196 and the 
initial weighting values 1 79, and generate the resulting weighting values 203 as 
30 described above in relation to Act 812. In an embodiment, the weighting adjuster 195 
may generate the resulting weighting values as described below in relation to Acts 158 
and 160 of Fig. 14. 
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The weighting adjuster 194 may store the resulting weighting values 203 and the 
ratings database 205 for later access. 

In aspects of determining recursively the impacts of two or more ratings on a 
result, the initial weighting values and resulting weighting values may be represented as 
5 weighting vectors or weighting matrices. Further, the plurality of provided ratings may 
be represented by a rating vector or rating matrix, as will be described in more detail 
below. Such vectors and matrices may be embodied tangibly on a medium using any of 
a variety of data structures, for example, an array. Accordingly, the terms "weighting 
array" and "rating array," as used herein, refer to a weighting vector or matrix and a 
10 rating vector or matrix, respectively, tangibly embodied on a medium as an array of other 
data structure. 

Fig. 14 is a flow chart illustrating an example embodiment of a method of 
estimating the impacts of a plurality of ratings on a result using vectors. In Act 1 50, a 
multi-rating vector is transposed to produce a transposed multi-rating vector. Each value 
15 of the multi-rating vector may represent an attribute or sub-rating of an overall rating or 
other qualitative assessment. 

Next, in Act 152, a resulting adjustment matrix may be generated from an initial 
adjustment matrix, the multi-rating vector and the transposed multi-rating vector. The 
resulting adjustment matrix may be generated by applying the following equation: 



where V t .j is an initial adjustment matrix, X t is the multi-rating vector, X t is the 
transposed multi-rating vector, and V t is the resulting adjustment matrix. As indicated in 

25 Equation 26, the initial adjustment matrix may be weighted by a forgetting factor, F 9 
similar to as described above in relation to Equations 18 and 19. The forgetting factor, 
F, may have the affect of giving the multi-rating vector more weight than the initial 
adjustment matrix in determining the resulting adjustment matrix. Alternatively, the 
forgetting factor may be chosen such that the initial adjustment matrix has more weight 

30 in determining the resulting adjustment matrix than the multi-rating matrix. 



20 



Equation 29 : V t = F • V t ^ + X t Xj , 



- In a next - Act 15 4 , t h eresulting adjustffleitt j jid l rix may be invcriodixrpr edeee^F^ 
TTTvoftod a 4 pmli iiL.nL ma Lii x. In a follo wing Act 156. a wetghting-mctdyfiea tinn maybe 
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uene i aled from the tran s posed multi-rating ve c tor .g n initial weighting Y frrt or am 
(e.g., an overall rating or other qualitative assessment). The weighting modification may 
be generated by applying the following equation: 



Equation 30 : 



where Y,,/ is the initial weighting vector, Y t is the result, and Z m0 d is the weighting 
modification. The^weighting modification represents a difference between the result Y t - 

^^^^ T 

and an egtkrfated result, X t Z t -i, according to the initial weighting vector and the multi- 
10 rati tfg vector. 

Next, in Act 158, a weighting adjustment vector may be generated from the 
inverted adjustment matrix, the multi-rating vector and the weighting modification. Such 
a weighting adjustment vector may be generated by applying the following equation: 



15 



Equation 3 1 : Z adj = V~ l X, • Z 



'mod 



where V," 7 is the inverted adjustment matrix and Z a dj is the weighting adjustment vector. 
The weighting adjustment, Z fl #, further may be weighted as a function of any 

number of factors. For example, the weighting adjustment may be weighted as a 
20 function of the reputation of the rater that provided the multi-rating vector and overall 

result, or as a function of some other factor corresponding to the transaction on which the 

multi-rating vector and the overall result are based, e.g., a factor indicative of the 

significance of the transaction. 

Next, in Act 160, the weighting adjustment vector may be added to the initial 
25 weighting vector to produce a resulting weighting vector. The resulting weighting vector 

may be generated by applying the following equation: 



Equation 32 : 



Z t — Z,_j + Z adj , 



30 



where Z t is the resulting weighting vector. 

In an aspect of using vectors to determine weighting values, each weighting 
vector includes an extra weighting value such that if there is a number of rating 
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parameters «, then the dimension of the weighting vector is n + 1. This extra weighting 
value may be used to factor in a parameter other than a rating parameter in determining a 
result parameter. 

For the embodiment of Fig. 14, estimated impacts of a plurality of ratings are 
5 determined for a single result. In such an embodiment, weighting vectors are applied to 
rating vectors and compared to a single scalar result. 

Alternatively, more than one result may correspond to a plurality of ratings. If 
more than one result is involved, the plurality of results may be represented with a 
vector, and the impacts of the plurality of ratings on the plurality of results may be 
1 0 represented by a weighting matrix, as opposed to a weighting vector. The use of 

weighting matrices and a result vector as opposed to weighting vectors and a result scalar 
are intended to fall within the scope of the invention. Weighting vectors and result 
scalars are described for illustrative purposes and are not intended to limit the scope of 
the invention. 

15 Equations 29-32 are derived from the minimization of the following recursive 

least squares (RLS) problem: 

z estate = ^"g min S f (Zj ) \ 
Equation33: where $ (Z t ) =^B(f,s)(£-XZfl 

.V=I 

B(t,s)=F{f)B(t-l > s); and 

20 where F(t) is the constant F described above in relation to Fig. 14. 

The above RLS problem, the theory behind the problem, and the several matrix 
manipulations needed to solve equation 30 to produce equations 26-29 are described in 
more detail in chapter 9 of the Madsen text. 

Other statistical methods for determining recursively a weighting vector for 
25 multiple attributes of a qualitative assessment, for example, variations of Equation 32, 
may be used. 

In an aspect of determining a plurality of weighting values indicating an impact 
of a plurality of ratings on a result, a estimated result deviation may be determined. In an 
embodiment of determining a estimated result deviation, the estimated result deviation 
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may be determined recursively. For example, the estimated result deviation may be 
determined by application of the following equation: 

Equation 34 : (rd-* J J^KTH^ -XjZ.f \ 

5 where RD? etght is the resulting estimated result deviation, i?Z),_, we ' ght is an initial 
estimated result deviation, F is a forgetting factor similar to as described above in 
relation to Equations 18 and 19, and T a is the effective number of estimated results 
similar to as described above in relation to Equations 18 and 19. 

Other statistical methods may be used to determine reliability of estimated results 

10 based on the estimated impacts of a plurality of ratings on a result. For example, a 

forgetting factor may not be applied, or an average deviation may be determined for all 
estimated deviations for the rated entity, or such an average deviation may be calculated 
with each estimated result deviation weighted according to how recent the estimated 
result was determined. For example, the estimated result deviation may be determined 

1 5 by applying the following equation: 

Equation 35 : RDr eight = JV'-'fc ~X T S Z S ) 

s=\ 

Fig. 15 is a data flow diagram illustrating an example embodiment of the system 
20 169 that generates a resulting weighting vector 204 to represent the estimated weights of 
a plurality of ratings in determining a result. The weighting generator 1 70 may receive 
as input an initial adjustment matrix 174, a multi-rating matrix 176, an overall rating (or 
other qualitative assessment) 178 and an initial weighting vector 180, and generate as 
output a resulting weighting vector 204. 
25 The weighting generator 170 may include an adjustment matrix generator 182, an 

inverse matrix generator 190, a transposed vector generator 186, the weighting 
modification generator 194 and the weighting adjuster 195. The weighting adjuster 195 
includes a weighting adjustment generator 198 and a vector adder 202. 

The transposed vector generator 1 86 may receive as input the multi-rating vector 
30 176 and generate the transposed multi-rating vector 184 as output. The adjustment 
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matrix generator 1 82 may receive as input the transposed multi-rating vector 1 84 and the 
initial adjustment matrix 174 and generate as output a resulting adjustment matrix 188. 
The adjustment matrix generator 182 may also receive the forgetting factor 172 as input 
and generate the resulting adjustment matrix 188 based at least in part on the forgetting 
5 factor 172. The resulting adjustment matrix 188 may be generated by applying Equation 



The inverse matrix generator 190 may receive as input a resulting adjustment 

matrix 188 and generate as output an inverse adjustment matrix 192. The weighting 

modification generator 194 may receive as input the transposed multi-rating vector 184 
10 and the overall rating 178 and generate as output a weighting modification 196. 

Optionally, the weighting modification generator 1 94 may generate the weighting 

modification in accordance with Equation 30 above. 

The weighting adjustment generator 198 may receive as input the weighting 

modification 196, the multi-rating vector 176 and the inverse adjustment matrix 192, and 
15 generate as output the weighting adjustment vector 200. The weighting adjustment 

generator 198 may generate the weighting adjustment vector 200 in accordance with 

Equation 31 above. 

The vector adder 202 may receive as input the weighting adjustment vector 200 
and the initial weighting vector 180 and generate as output the resulting weighting vector 

20 204. The vector adder 202 may generate the resulting weighting vector 204 in 
accordance with Equation 32. 

The weighting generator 170 and any components thereof, including adjustment 
matrix generator 182, inverse matrix generator 190, transposed vector generator 186, 
weighting modification generator 194 weighting adjuster 195, weighting adjustment 

25 generator 198 and vector adder 202, may be implemented as software, hardware, 
firmware or any combination thereof. The weighting vector generator 1 70 and any 
components thereof may reside on a single machine (e.g., a computer), or may be 
modular and reside on multiple interconnected (e.g., by a network) machines. Further, 
on each of the one or more machines that include the weighting vector generator 1 69 or a 

30 component thereof, the generator 170 or component may reside in one or more locations 
on the machine. For example, different portions of the weighting vector generator 170 or 
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different portions of a component may reside in different areas of memory (e.g., RAM, 
ROM, disk, etc.) on a computer. 

The system 169, and components thereof are merely example embodiments of a 
system for generating a ratee reputation. Such example embodiments are not meant to 
5 limit the scope of the invention and are provided merely for illustrative purposes, as any 
of a variety of other systems and components for estimating the impacts of a plurality of 
ratings on a result may fall within the scope of the invention. 

For any of the methods or systems described herein in relation to Figs. 2-17, any 
number of entities may be members of a population. This population may be grouped 
10 into clusters having common properties, for example, similar demographics or 

preferences. Further, for a transaction having multiple parameters, for example, multiple 
• rating parameters, the entities of the population may be grouped into any number of 
clusters based on the statistical similarity of the ratings they provide for the parameters. 
The entities may be grouped in to clusters using any of a number of known clustering 
15 algorithms, for example, a k-means clustering algorithm, an example of which is 

described at : http : //www. cne . gmu. edu/modules/dau/stat/clustgalgs/clust5_bdy . html . 

If a population of entities is grouped into clusters, reputations, estimators, 
deviations, and other values may be determined for each cluster separately. For 
example, weighting vectors and associated matrices may be generated and maintained 
20 independently for each cluster. 

VII. Generating a Third Estimated Ratee Reputation By Combining a First 
Estimated Ratee Reputation With a Second Estimated Ratee Reputation 

Described above are example embodiments of systems and methods for 
25 estimating a ratee reputation. For example, determining an estimated ratee reputation of 
a first entity using the rater reputations of one or more entities that provided ratings for 
the first entity is described above in relation to Figs. 8 and 9. 

As described above, if one or more attributes are provided for a single exchange 
with a ratee (e.g., one or more ratings are provided by a rater), an estimated ratee 
30 reputation may be determined for each attribute. As used herein, an estimated ratee 
attribute reputation is an estimated ratee reputation determined for one of multiple 
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attributes for a single exchange, as opposed to an estimated ratee reputation determined 
for a result or qualitative assessment associated with the single exchange. 

Further, determining an estimated result by applying initial weighting values to 
associated attributes, e.g., received ratings, is described above in relation to Act 808 of 
5 Fig. 12. If the estimated result described in relation to Act 808 is an overall rating, then 
initial weighting values may be applied to associated attributes to estimate a ratee 
reputation of an entity. 

It may be desirable to combine two or more estimated ratee reputations to 
produce a new estimated ratee reputation. The deviation of such a new estimated ratee 
10 reputation over time from actual received ratings may be used to determine whether the 
new estimated ratee reputation is more accurate than the two or more estimated ratee 
reputations. Accordingly, provided herein is a method and system for estimating a ratee 
reputation of a first entity based on multiple estimated ratee reputations of the first entity. 
Fig. 16 is a flowchart illustrating an example embodiment of a method 600 of 
15 combining a first estimated ratee reputation of a first entity with a second estimated ratee 
reputation of the first entity to produce a third estimated ratee reputation. A reputation 
database, for example, the reputation database 726 described below in relation to Fig. 17, 
may store a first estimated ratee reputation and one or more ratee attribute reputations. 
The first estimated ratee reputation may have been generated by combining a 
20 plurality of overall ratings, where each overall rating was provided by a different entity 
for a corresponding transaction. For example, the first estimated ratee reputation may be 
determined from the plurality of overall ratings in a similar manner to that described 
above in relation to Figs. 8 and 9. 

Each of the one or more ratee attribute reputations may have been generated by 
25 combining a plurality of attributes, where each attribute corresponds to a different one of 
the transactions. For example, each of the one or more ratee attribute reputations may be 
determined from the plurality of attributes in a similar manner to that described above in 
relation to Figs. 8 and 9. 

In Act 602, the one or more ratee attribute reputations are received. In a next Act 
30 604, for each received ratee attribute reputation, a corresponding weighting value is 

accessed. The accessed weighting value represents an estimated weight of the received 
ratee attribute reputation relative to others of the one or more received ratee attribute 
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reputations in estimating a ratee reputation of the first entity, similarly to as described 
above in relation to Act 806 of Fig. 12. 

Next, in Act 606, a second estimated ratee reputation of the first entity is 
determined by applying each weighting value to its corresponding ratee attribute 
reputation. For example, the weighting values may be combined with the corresponding 
ratee attribute reputations similarly to as described above in relation to Act 808 of Fig. 
12 and Act 156 of Fig. 14. 

In a following Act 608, the first estimated ratee reputation is accessed, for 
example, from a database. Act 608 may be performed serially or concurrently to the 
sequence of Acts 602-606. 

Next, in Act 610, the first estimated ratee reputation and the second estimated 
ratee reputation may be combined to produce a third estimated ratee reputation. For 
example, the average of the first estimated ratee reputation and the second estimated 
ratee reputation may be determined such that the third estimated ratee reputation is an 
average of the first and second estimated ratee reputations. 

Option ally, the first and second ratee reputation may be weigh t ed bye stimatg 
ratee reputation deviations to calculate a weighted average. For example, tp-determine 
the third estimated ratee reputation, the following equation may be ^ptfned: 



Equation 36: R 3 = - 1 




RD 



rater 



weight 



where R i is the first estimated ratee'reputation, R2 is second estimated ratee reputation 
and R3 is the third estimated^ratee reputation. RD™ ier is a first estimated ratee reputation 
deviation correspondifig to the first estimated ratee reputation and may be determined by 
application ^Equation 34 or 35 as described above. RD™' 8 *" is a second estimated 
ratee jef5utation deviation corresponding to the second estimated ratee reputation and 
ietermined bv a p plic ation o f F qnntion ° 1 m rlnrrihrri nhnyp — • 

Ar . Hnr.nrihnH n hnvn in rnlnti nn l u Fi^sT I ^ 34 mul 1/ j t for n Civr n PT tim n t r ri m trr 

reputation^JttghCT^sfimated ratee reputation deviation represents a lower reliability of 
estimated rat** 1 ■ ^ | > ■ 1 1 ^ ■ I i ■ ■ ami, mnw.i.kHly , a 1i»w***^&±irpflt ed ratee rep utation 
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rdr vm l i iMi p^ mpsvi iI s h hi^h^r i ^ K aHlity th" ^ti™ a tH r fltft p re putation. Therefa 
both the first and second estimated ratee reputations were^^ei^tea^ccording to their 
respective ratee reputation deviatioiis,rA©-ratSel : e^tation with a higher deviation and 
lower reliability woukh'be'given more weight (i.e., have a greater impact) in generating 
the third gstifnated ratee reputation, which consequently would generate a less reliable 
thjgljestkttated ratee reputatio n than that defined by Equation 36 . 

Accordingly, in Equation 36, to weight both the first and second ratee reputations 
according to their respective reliabilities, the first ratee reputation is weighted by the 
second ratee reputation deviation, and the second ratee reputation is weighted by the first 
ratee reputation deviation. As a result, of the first and second ratee reputations, the ratee 
reputation having the higher reliability will have the greater impact on the third estimated 
ratee reputation. 

Eig? 17 is a -data flow diagram illustrating an example embodiment uf a - system 
700 for generating an estimated ratee reputation generator. The systemJOO^fiay include 
a reputation database 726 and an estimated rateercputatiertTgenerator 706 that includes a 
first ratee reputation estimatorJZOS-^iiaTsecond ratee reputation estimator 712. The 
reputation datatxase-^TT^may be a reputation database or similar data structure as 
«rTKeH bfilow in relatintLiQ-Eigc-4-8* 

fl l^ ^v I MUHM IH l ^ 1 - " ■ [" ■l^l nm ^nprgtnr 706 may reppivp rafpp attn'Vmtp 

reputations 702 and a ratee ID 704. The ratee attribute reputations 702 may be 
determined, as described above, from attributes correspondingtp-tfansactions with a first 
entity, and the ratee ID 704 may indicate the first entity^The estimated ratee reputation 
generator 706 may use the ratee ID 704 to acpesgTfrom reputation database 726, 
weighting values 718, first estimate^Urafee reputation deviation 720, second estimated 
ratee reputation deviationJ£22"and second estimated ratee reputation deviation 724. The 
estimated ratee refutation generator 706 may use values 718, 720, 722 and 724 to 
generate^-tKird estimated ratee reputation 714, for example, as described above in 
ti on to Fig. 16 . 

Thr firtf ffltPf re put a tion e stimator 708 mny rrrnivp thcnnGng gbre mine 
attribute reputations_702ji^ ratee reputation 710, for 

^Xm=mj gr^^ grr ^^ ■ahnvp in rphtinn in A rt 606 nf thp Fig 1 6 
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The second ratee reputation estim at or / 12 may leceive the fiisl estimat e d rat i 
eputation deviation 720, the second estimated-a^atee-rer^^ and the second 

^estimatedj; 
T 



eputation deviation 724 and generate the third estimated ratee reputation 

se ainple, as des cr ibed above iirr elation to Aci 6i"0~ uf Fig. 16 : 

The estimated ratee reputation generator 706, and any of a combination of its 
components, including first ratee reputation estimator 708 and second ratee reputation 
estimator 712, may be implemented using software, firmware or hardware or any 
combination thereof. The estimated ratee reputation generator 706 and any components 
thereof may reside on a single machine (e.g., a computer), or may be modular and reside 
on a multiple interconnected (e.g., by a network) machines. Further, on each of the one 
or more machines that include the estimated ratee reputation generator 706 or a 
component thereof, the generator 706 or component may reside in one or more locations 
on the machine. For example, different portions of the estimated ratee reputation 
generator 706 or different portions of a component may reside in different areas of 
memory (e.g., RAM, ROM, disk, etc.) on a computer. 

System 700, and components thereof, are merely example embodiments of a 
system for estimating a ratee reputation. Such example embodiments are not meant to 
limit the scope of the invention and are provided merely for illustrative purposes, as any 
of a variety of other system and components for estimating a ratee reputation may fall 
within the scope of the invention. 




VIII. System Architecture 

Figure 1 ft fc ^ rhtT flow Hing r nm ilhiatrnting nn pvamplfi gyqtem arrhiterti^re 9flQ 

for implementing the methods, systems and variations thereof described abo3ie-tiTrelation 
25 to Figs. 2-17. The system 209 may include a client 210, a servej^f2, a rater reputation 
database 234, an authentication I.D. database 236 and-arfater reputation database 238. 
The components 210, 212, 234, 236 and 23S^5fthe system 209 may have a variety of 
configurations. For example, all^th^se components may reside on a single computer, or 
any combination thereo£*tfay reside on a separate computer or multiple computers 
30 interconnected^ibfexample, by a network. Further, any combination of these 

components may reside on separate networks, including separate LANs (Local Area 

r k-s)., M-ATvTg (Metropolitan Area TMprwnrJc n ) nnd WATsJg (W i de Arra -M erwnrW) r 
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The ratee reputation database 234 may contain one or more entries, where each 
entry represents ratee reputation data for an entity. For example, an entry in the ratee 
reputation database may include an entity I.D., demographic information about the 
entity, ratings of the entity provided by other entities, a ratee reputation of the entity, a 
5 ratee reputation deviation of the entity, weighting values corresponding to attributes or 
rating parameters or items, goods, services, people, etc. associated with the entity, and 
other information regarding the entity. 

The authentication LD. database 236 may include one or more entries, where 
each entry represents an entity that is part of a population using a ratee reputation 
10 system, a rater reputation system, or a combination thereof. An entry in the 

authentication I.D. database 236 may include an LD. of an entity, demographic 
information about an entity, a password for the entity, and other information regarding an 
entity. 

The rater reputation database 238 may include one or more entries, where each 

15 entry represents data specific to an entity. For example, an entry in the rater reputation 
database 238 may include an entity I.D., demographic information about the entity, 
ratings provided by the entity, a rater reputation of the entity, a rater reputation deviation 
of the entity, and other information regarding the entity. 

Each of the databases 234, 236 and 238 may be of any type of a variety of types 

20 of databases, including a relational database (e.g., Microsoft SQL or Oracle) that stores 
data as entries in tables, an object-oriented database that stores data as objects or a flat 
file database, where entries are stored as records and separated by delimiters. Further, 
each of the databases 234, 236 and 238 may each be part of single database. For 
example, a single database may maintain an entry for each entity, where each entry 

25 includes an LD. of the entity, authentication data of the entity, ratings provided by the 
entity, ratings of the entity provided by other entities, a ratee reputation of the entity, 
weighting values, and a rater reputation of the entity, as well as other information. 

The server 212 may include a frontend 230 and a backend 232. The frontend 230 
may include a user interface and may receive and send instructions and other data to and 

30 from the client 210. The frontend 230 may then transfer and receive instructions to and 
from the backend 232. 
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The backend may determine ratee reputations, rater reputations, ratee reputation 
deviations, rater reputation deviations, weightings, and other metrics and values such as, 
for example, as described above in relation to Figs. 2-17. 

The backend 232 may also receive queries 216 submitted to the frontend 230 and 
5 translate these queries to database queries on one of the databases 234, 236 or 238. The 
backend 232 may also transfer updated reputations 244, ratings 246 and weightings to 
the various databases. 

The client 210 and the server 212 may be implemented as software, firmware, or 
hardware, or any combination thereof. For example, the client 210 and the server 230 
10 may be implemented as software using any of a variety of programming languages, such 
as Java, C and C++. 

Through the client 210, an entity may submit one or more ratings 224 to the 
server 212. Included along with the ratings 224 may be a rater ID that identifies the 
rating entity and a ratee ID that identifies the entity being rated. The server 212 may 
15 then determine a ratee reputation, a rater reputation, weightings, and other information in 
accordance with the various techniques described above in relation to Figs. 2-17. 

For example, to determine a ratee reputation of the rated entity, the server 212 
may submit a ratee query 240 to the ratee reputation database 234 and extract various 
data corresponding to the rated entity, including the current ratee reputation and previous 
20 ratings of the rated entity provided by other entities. This data may be sent from the 

ratee reputation database 234 to the server 212 as query results 242. The server 212 then 
may use the query results 242 and the received ratings 224 to determine a ratee 
reputation of the rated entity according to any of a variety of the techniques described 
above , then may send the ratee reputation 226 through the frontend 230 to the client 



The server 212 may store or persist the one or more ratings 224 and the updated 
ratee reputation 244 by sending to the ratee reputation database 234, for example, to an 
entry corresponding to the rated entity, and by sending the one or more ratings 224 and 
the updated ratee reputation to the rater reputation database 238, for example, to an entry 
30 corresponding to the rating entity. 

Similarly, to determine a rater reputation of the rating entity, the server 212 may 
submit a rater query 248 to the rater reputation database 238 and extract various data 



25 
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corresponding to the rating entity, including the current rater reputation and previous 
ratings of other entities provided by the rating entity. This data may be sent from the 
rater reputation database 238 to the server 212 as query results 250. The server 212 then 
may use the query results 250 and the received ratings 224 to determine a rater reputation 
of the rated entity according to any of the techniques described above through the 
frontend 230, the server 212, then may send the determined rater reputation 226 to the 
client 210. 

The server 212 may store the one or more ratings 224 and the updated rater 
reputation 244 by sending to the ratee reputation database 234, for example, to an entry 
corresponding to the rated entity, and by sending the one or more ratings 224 and the 
updated rater reputation 244 to the rater reputation database 238, for example, to an entry 
corresponding to the rating entity. 

The server 212 may use similar techniques to access the ratee reputation database 
234 and the rater reputation database 238 to determine other values as described above in 
relation to Figs. 2-17, including determining ratee reputation deviations, rater reputation 
deviations, personalized ratee reputations, weightings, estimated results, and estimated 
result deviations. 

For example, in response to receiving a plurality of ratings 224 and a result from 
the client 210, the server 212 may access the necessary values in the ratee reputation 
database 234 and/or the ratee reputation database 238, determine resulting weighting 
values, for example, as described above in relation to Figs. 12-15, and then sending the 
weighting values 2 1 4 to the client 210. 

J?iirth g r thp c^rwpT 0] 2 S thro ugh the frontend 230, may receive a usen miery 216 ^ 
from the client 210. For example, the user query may be requestingjlifi-faterreputations 
of one or more entities, the ratee reputations of onejor~m(5feentities, or the personalized 
ratee reputation of one or more en^liesdxom the perspective of a particular entity. The 
server 230 may conv^theuser query 216 into a database query, for example, a ratee 
query 24Q^rifrater query 248, and send the database query to the appropriate database. 
Th^server 230 then may send the query-results 218 to the client 210r-» 

The gp . rvp,r7in mny he, pnrt nffin nn-l i nr. m.n r Vptplnnn fnr pygmpl^^n^ ggrrU^ 

mediated marketplace^^ niayr equest and receive marketplace 

f iiiieriilSRon 220 from the server 230. Further, the server 230, as pail uf a-^ansaction^^ 
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b'etween an entity correspo nding Lo th e client 210 and a c omvi^^tj^ity^my send - 
communications 222 to the client 2 ^K^JDie-eoifirm^ 222 may include 

notifications pertainirig-^o^iecui^ transaction, prompts for information from the 
entity cofres^onding to the client 210, reputations of the counterpart entity, and other 
mfomxation^a b ou t the entity including demographic data, weighting valu e s, etc. 

During the context of an exchange between the entity corresponding to the client 
210 and the counterpart entity, the client 210 may send instructions 228 to make a deal, 
for example, instructions to purchase a good. 

The client 210 m a y include a user interface to allow interaction between ausgg ' 
and an application, for example, a reputation apglis^iion^ application 
implemented using the client^iO-afia'server 230. The user interface may involve using 
CGI scripts to^ertefate web pages in accordance with any of a variety of markup 
lzyagrtSges^ uch-as; fo r exam pl e, HTMI^ - XML or SGML. - 

The several methods described herein, and the various embodiments thereof, 
including the methods and embodiments described in relation to Figs. 2, 3, 8, 10, 12, 14, 
16 and Equations 5-35, may be stored on a computer-readable medium as computer- 
readable signals. For each method or embodiment thereof, the computer-readable signals 
may define instructions that, in response to being executed on a computer, perform the 
method or embodiment. Each method or embodiment thereof may be implemented using 
software, firmware, hardware, or any combination thereof. If implemented as software, 
the computer-readable signals defining the method or embodiment may be part of a 
computer program product, such as a software program written in any of a number of 
languages such as, for example, C, C++ or Java. 

Having now described some illustrative embodiments, it should be apparent to 
those skilled in the art that the foregoing is merely illustrative and not limiting, having 
been presented by way of example only. Numerous modifications and other illustrative 
embodiments are within the scope of one of ordinary skill in the art and are contemplated 
as falling within the scope of the invention. In particular, although many of the examples 
presented herein involve specific combinations of method Acts or apparatus elements, it 
should be understood that those Acts and those elements may be combined in other ways 
to accomplish the same objectives. Acts, elements and features discussed only in 
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connection with one embodiment are not intended to be excluded from a similar role 
other embodiments. 

What is claimed is: 



